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ABSTRACT ^ 

^ Presented is the annual (1974) report^ of a project - 

for the investigation and application of behavior analysis and ' 
modification with, handicapped children. The jprogram project is 
designed to assist teacher^ in the- i^ol^owing areas: curriculum for 
mildly/moderately handicapped .chijfdren being served in regular 
classes ^lid for severely handica|)ped children in special classes, 
appropriate instructional procecrares^i instructional ma'terials ^and ^ 
program packages for children uith a vide range of handicapping 
^conditions, and mea spire me D;t and *assess«ent proceftures^L^^K^l-^ 
are giveni to the ' work of three te.ams— aA teaB-capcerned primarily with 
developing carri9ulum for use w±th handicapped children who are in 
regular classrooms/ a team focusing on curriculum for children with 
moderate to severe handicaps, and a team to develop detailed task 
analyses for various ^basic sMills and/ specific instructional programs 
for various basic skills.* Seven papers are included to. describe the 
work of team 1 on' curriculam re^arCh in&iud^iig topics>such as 
plac4:pg tjid^ child in tte righ^t r&ader, th^ improvement 'of o^ral 
reading and comprehension, and the Effects of ^reinforcement 
cfintingencdes on computational ''arit/hmetic performance. Considered is 
the vork of ^Team 2 ^in the aireas of measurement, administrative 
management decision system, intake- ret*urn.*fpllowup, establishing 
qriteria performarroe levels, and instructional procedures. Included 
for Team 3 is inf ormation,^on» th6 prototypic iiofiel and programs such 
as making change, tellii^ \im€r, ^fastening clothes, and shoe tying. 
(DB) - ' ' ^ ^ 
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Introduction - . 

Increased demands have been placed on schools to Integrate more ' 
severely handi^pped chl Idren, Into school programs and to assume total 
responslbl lf?y^ for their Instruction, As a result, special educatfon 
personnel who have pVevlously served ^mi Idly and'moderately handicapped 

*(7hlldren must noW turn'' their efforts toward the more severely .handi-* 
capped; and regular classroom teachers must learn to edutate mildly and 
mpderately hand! capped • chf Idren Without regular and. continued assistance 
from special educators, Bpth^ the regular tdacher and th^ special educa- 
tion teacher will be faced .with* a population of children with which they 

'have very little experience* During the period from September,!, 1973 
tp July 31, 197^ Program Project has continued to vyork toward its goal 
of assisting^ln the provision of abproprlate education »for all children 
by attending to the needs of teachers created by this shift In educa- 

^tional placement and responslbl I H ty. Specifically, Program Project has 
continued Its activities and l^esearch designed to provide assistance and 
Infbrmatlon to teachers; concern! ng four major areas:.. 1) curriculum.* 
appropriate for mildly/moderately handicapped children being served. In 
regular education settings and for severely, handicapped chlldrbn being 
servednn sel f -don tallied special education classes; 2) instructional 
procedurjes. appropriate for each of the target populations in eacii lype 

.of setting; 3) Instructional materials and program packages which faci- 
lltate-the progress of children with a wide range of handicapping con- 
ditions; and /♦) measurement and assessment procedures which enable the 
teacher of either fiii Itlly/moderately handicapped children or sevejely 
handicapped children to select' or devise the best possible educational 
prpgram for each child, to monitor the effects of those programs, and to 
modify them as required. , 



Program Project Currjculum Research 



All of th6 Program Project teams have^ been engaged in determining 
curricula appropriate for children with varying degrees of handicapping 
conditions. Team I has been concerned primarily with developing a 
curriculum to be employed In regular classrooms with mf Id/oiodeVately 
ftandicapped children or pupils with learning disabilities. Team II has 
conducted similar research on' curriculucn design for children with- moder- 
ate- to severe handicaps. Team ill has developed detailed task analyses 
for various basic skills, for which they have developed specific instrgc 
tional programs. 

Program Project Instructional Procedures Research 

Once the curricula have been specified, t;he question of. instruc- 
^t-ional procedures arises — how a currlcujum Is to be taught. Again, all 
three teams are* involved In this effort. TKe activities of Teams Land 
II are particularly concerned with different ^nstructlonal procedures. 
Becaus'e each team deals with different types of handicapped children 
jf^i^^pr different curricula, however, tbeif* work is not dupMcative. 

/ • ' . ^ ■ ' ■ 
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Teams, coordinate thei»* activities to produce mutually illuminating, but 
♦ * ^ ^not re*petltlve^ resu'.ts. 

V > . ^ y ' ^ ' / ' . ' 

Program Project^- Instructional >rog«*anis Research , 

The' requisi tes^ foj program developn^ent Include': * I) accurate probes' 
to assess pupils' entering performance- levels, thereby avoiding poor 
placements and -lost time; 2) discrete and correctly sequenced ^eps 
which lead smoothly to mastery of each skill regardless of the chFld's 
entry behavior; j) additional drills and activities for children requir- 
ing assistance beyond th^ 'basic program; k) the requl rement of active , 
responses from the child a t*^ each level of the progra.Ti to' Insure that the 
learning process is observable and mevisurable; 5) provision for self- 
- recording and scoring not only to'reduce the teacher's workload but also 
to provide more Immediate feedback to the child; 6) "mastery" tests at 
t ^appropriate Intervals in the program sequence to Insure that the child 

IS prep^ared to undertake h4gher- level program tasks; and 7) an emphasis, 
" ; whenever possible, on "teacher-free" InstrgctionaJ procedures, to-pilnl- 

^ mlze program costs yet optimize 'the program' s responsiveness to Indivi- 

dual pupils^ needs. 

iiaterials^ appropriate for use with chHdren with varying degrees of 
'handicapping conditions have been developed by all teams, but Team 111^ ^ 
^ has engaged In materials deyetopment more precisely and systenj^t leal ly • 
^' ^ Team III materials represent complete packages for the Instruction of 

handfcapped children in several baste skill^s areas. Though designed fpr 
* the Severely handicapped child, each program Is appropriate for use with 

moderately handicapped quo lis as well, 

^ Program f^roject Measurement Procedures Research 

Baste "to any Consistently effective educational program Is a sound 
system of measurement. Program Project Is a behavtora Jly^ biased research 
effort requiring the continuous assessment of each child's performance 
under each condition to be studied. The process of learntng.ls closely 
' scrutinized on a dally basis, so that changes In the' program' may be made 
Immediately whenever necessary to minimize or avert "failure". There 
are several stegs In the sequeyace'of measurement followed by the Program 
Project teams. First, the child must be referred to the right program 
for the right purpose. Tliept quick, accurate assessment of the pu{>n*s 
present skills must be made to determine each child's entry level within 
each program. Third, accurate monitoring of the child's performance ' ' 
must be continuous In order to modify his program, If necessary, at that 
« tlme^when the change will be most beneflcl'al. Finally, after attaining ^ 

all specified program objectives, the child Is ready to. be* placed In 'a 
regular classroom or other appropriate program* The progress of chl.ldren 
Is assessed cont^lnually during all "reintegration" efforts, and again at 
regular follow-up Intervals. For each step In this sequence, several . 
alternative approaches have been devised and ^tested by the Program " 
Project teams, especially Team 11,^ to meet the needs of children with a 
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wide range of handicapping conditions and coming from or returning to a 
wide variety of situations. 

Evaluation 

Progress toward the stated goals of the Program Project has been 
steady" and productive over the past year. The teams approtfah their work 
with the scfentlfic rigor required of functionally sound research, and 
at the, s?me time maintian a high level of practicality in' the questions 
they address. The teams are separate, but mutually supportive; the 
differences In the populations they serve and the questions they address 
Insure that the Program Project, v;M1 provide information and materials 
of concern to a^wlde range of programs serving handicapped children^ 
The commonal f t ies In tfie research approaches employed by the teams, on 
the other hand, increases .communication and cooperative'' interaction* i 
o'^mong them; and provides a broader data base for the geiferal Izatlon of 
research results to the target populations of ini Idly , moderately , and 
severely handicapped children. 

Information about the specific accompi i shments„ of ,the three teams 
follow in the body of this Anaual Report. Teams I and 11 have reported 
their work In a series of papers describing measurement and other instruc- 
tional procedures and findings. Team III, whose work Involves the 
development and field testing of Instructional programs, has submitted 
reports on prbqram development and completion. 



TABLE OF CO;JTE'ITS 

V. 



I urn 



Introduction 

Team' I: Curriculum Research 

AppUed Behavior Analysts Techniques and Curriculi 

Research: Itnpl i cat ions for Instruction '(T. Lovltt) 
kound One--Placing the Child in the Right Reader ' 

(T.jLovitt.S C, Hansen) 
The Use of Contingent Skipping and Drilling to 

Improve Oral Reading and Comprehension (T. Lovitt 

S C'. Hansen) 

The Differential Effects of Reinforcement Contingencies 
on Computational Arithmetic Performance '{D, Smith S 
V Lovitt) 

" Oh: Th^t This too Too Solicf Flesh Would Melt (The Erosion 

^ of Achievement Tests) (T. Lovitt S M. Eaton) 
/ The Relationship Between Question Type and Mode of Reading 
on the Ability to Comprehend (C. Hansen 6 T. Lovitt) 
The Minimal Effects of Three DIfferetrt Types of Feedback 

in Three Different Arithmetic Situations (C. Blankenship 
V <^3nd T, Lovitt) 



Team II: Asses-sment, Instruction, and Integration of Handicapped 
Children 
Introduction 
Area I : Measurement 

Rationale, . ^ • * , 

Progress 1973-197^ * . / . 



1 



Area M: Administrative A^nagement Decision System 
, Rationale 

Progress -1973-197^ , . ^ " ' ' 

Area ill: I ntake-Return-F'ol low-up/* 

Rationale ' 

Progress" 1973-197^ / 
Area IV: Establishing Criteria Performance Levels 

•Rationale ^ ' ^ 

^ Progress 1973-197^ - \ 

Area "V: Instructional Procedur^sr ^ / 



Rationale 

Progress 1973-197^ 
Refehences 



\ 



Team 1 1 1 Research and AppUcation of a Prototypic Model for 
Instructional Material Oevelopjnent 
The Prototypic Model < 
Prerequisite knowledge 
^ Primary decisions \ * 

Lattice .developed 

^ • •> ^ • 

Pretest package 

Pjogram format 

e 

Initia"*! fieldtest population 
Initial fieldtest 
" Secondary f ieldtestirig * 
Final fleldtesting * ^ 

I nstructiorial program developed ^ 



Status In September 1973 • 
Bres^nt Status ' " 

^Refinements of the Prototypic Model' 

Possess prerequisite knovvHedge . ' 

Make primary decisions \ 

Develop lattice"for ins truct ionaV^program 

Final pretest package 

Decide on Program/ s format 

Determine initial fieldtest population 

Initial fieldtest* 

Secondary fijldtes^t 

Final fieldtest of the entire p/ogram 

Instructional program developed for specif ic learning . task 
Application of the Prototypic Model: Instructional Program 
' Development * ' , ' 

The Shoe Tie Program ' ^ • 

Terminal goal and .target population 

Skill sequence 

Pretjsst procedures 

Lesson procedures and materials^ ' . * 
Initial fieldtest results 
Secondary fieldtest results 
Curref^t status 
Make Change Program 

Terminal goal and turget population 
Skill sequence 

Pretest procedures ' ^ ' ) 



Lesson procedures and materials: Coin discrimination 



Lesson'procedures and hiaterlals: Bill discri.nination 
Lesson procedures .and' mater ials : Money values 
Lesson procedures jand materials :^ Coin combinations 
Initial fieldtest results: Coin discrimination 



Initial fieldtest results: Bill discrimination 
Initial fieldtest results: Money values 
Initial fjeldtest results: Coin combinations 
Current status ^ > ' 

The Time Telling Program ; 
TermlnaUgoal and target population 




1 1 sequence 



• Pretest procedures 



Lesson procedures and materials 



Initial fieldtest results 



Current status 



r 



Clothes Fastening Program 



Terminal goal and target* population 



Skill sequence 
Pretest procedures 



Lesson procedures and .aterlals 



Initial fieldtest results 



V 



Current status 



The Ruler. Measurement Program 



^-Terminal goal and target population 



SkiUl sequence 



•5" 



Pretest procedures " 

Lesson procedures and materials 

Initial fleldtest results 

Current status 
The Metric Measurement Program 

Termfnal. goal, and target populatTon 

Ski 1 1 sequence v 

Pretest procedures 

Lesson procedures and materials 

Initial fleldtest results 
"* Current status \ 
Samrtiary ' * 
References 

Appendix: The Shoe Tie Program 



1> 



<' TEAM I: 



CURRICULUM' RKEARCH 



Team Members Coordinator: Dr. Thomas C, Levitt 

V^, Head Teacher: Cheryl L\ ^Hansen 

V ' Assistant Teachdr: Kathy Ashworth 

\/ark Study: • Bonnie Finholt 
* • 

Secretary Oksana Diachok 



0 

V 



r 



5 , 



APPLIED BEHAVIOR ANALYSIS TECHNIQUES 

AND CURRICULUM RESEARCH: IMPLICATIONS/FOR INSTRUCTION 

< 




Tom Lovitt 



University of Washington' 



> / 



Graditude i,s expressed to the folluwing researchers ^ho managed the 
investigations reported here: Karen Curtiss, Mary Kirkwood, Marie Eaton, 
Cindy Thompson, Colleen Blankenshi'p, Cheryl Hansen, Debby Smith, 
James Smith, Mary Hurlbut, and Tal Giippy. ^ ^ * 



APPLIED BEHAVIOR ANALYSIS TECHNIQUES- ' " 
AND CURRICULUM RESEARCH; IMPLICATIONS FOR INSTRUCTION 

♦ - . * » 

* . . Tom Lovitt ' ' 

I 

N ^ University of Washington 

This chapter is a presentation of the curric^Ov^'-i research my asso^ 
ciates ^nd I have* conducted with elementary a, Uuen duiing the past 

SIX years usihg Applied Behavior Analysis techniques. The purpose of 

1 

the chapter is to offer instructional suggestion's to teachers based on our 
research. A second objective is directed toward other curriculum research 
ers; who, we hope, will be stimulated to refine and extend the notions of 
some of our projects . , • j 

Curriculum, as' used in this report, re^rs to the -many learning 
activities of elementary age cnildren, such as reading, \yriting, arith- 
'tnetic, penmanship, spelling, (purriculum, as the term is here used, also 
includes the many teaching jDrotedures that are selected to a^jsist in the^ 

development of academic^ skills. Si5me of these procedures are modeling, 

• ' . "^-^ 

feedback, reinforcement contingsncies, verbal directions. ^ 

- Following is an outline of this chapter . The first section is an \ 

explanation of the Applied Behavior Analysis methodology, presenting 

first a/E^ief outline c^f ^the development of this' method, folfowed by a 

description ^^J^ basic components of the method. The second part of 

the chapter is a description of the setting and students used for the cur- 

riculum research. ^ . f , 

* 

In the third and most important section is a description of several 



research studies. These ;stuciies will be presented by subject matter area: 

reading, arithmetic; spl^lling, communication, and^upil management . In 

^he final section some suggestioHs for future curpculum research are offered. ' 

, r ^ ' ' * , APPLIED BEHAVIOR ANALYSIS . ) 

^ Brief History of Applied Behavior Analysis * " . 

Applied. Behavior Analysis procedures, although of recent origin, have 

a rich and substantial heritage. Skinher, the founder of operant* conditioning, 

/ 

provided the substance of what is today 4<:nown as Applied Behavior Analysis. 

One of his many contributions was his support of the belief that frequency 

of responding was the basic datum of science. Response frequency has become 

a key element of the Applied Behavior Analysis technology. Ai^other conti:*ii- 

bution of Skinner's to today^s technology is the notion of estaW^shing functjon- 

al relationships between independent and dependent variables, Perhap^' 

his greatest .gift to Applied Behavior Analysis was that he^ so dramatically > 

proved that many behaviors are influenced by various reinforcement contin- 

gencies, ' . ' * ] f - 

\ 

From that beginning of operant psychology several branches*of experi- 
mentation developed. Some researchers continued, as did Skinner, to use 

lower organisms as subjects. Some conducted laboratory experimentation 

f" 

with humans. Others began to work with adults and children in institu- 

tions for the psychotic and retarded. 41^hou^h many of these researchers 

/ 

contributed to what is now Applied Behtivior Analysis, I would like merely 



to trace the dev'elopment of Apolied Behavior analysis as it related to chil- 
dren. 

Some of the early work with children using operant procedures was 
basic or laboratory research. These studies were conducted in settings 
not natural to th<.. chlld*s environment, and the responses the children 
were i^equired to emit were not normally in their repertories. The purpose 
for these studfe^ was to learn about certain conceptual systems rather tha^i 
about the normal behaviors of children. . - ^ 

y One such study was the now classic Azrin and Lindsley (1956) re-' 
search, which examined the acquisition, extirfction, and maintenance of a 
^ooperative bt^havior. Baer and S^rman (1964) studied the generalized 
invitations of children. Bijou in 1958 studied the performance of children ' 
during extinction phases following various fixed interval schedulV'^ These 
laboratory studies with children accomplished what* they set out to do: they 
demonstratec? that many of the principles of operant psychology which apolie 

, ^o animals hold true likewise for children . 

^ - J-. 

Encouraged by' the successes of 'these laboratory findings, others 
began to use ojperant techniaues with children in clinical settings. The 
classic study of this type was reported by Wolf, Risley, and Mees (1964) . 

They dealt with several behavior^ df a young autistic* boy in the clinic and 

0 

the home, Lovaas (Lovaas^, IJ'reitag. Kinder, Rubenstein, Schaeffer, and 
Simmons, 1966; Lovaas, Freitag , iNelsoh, and V.^halan, 1967) in several studi 
used operant proccd^ures to chango^various behaviors of sfchizoplu-enic 
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youngsters. There were several other studies of thiS'^typc- whei e operant 
procedures were used to change, generally attenuate, the beha\"ors of 
children. They had in comTion the fact that they dealt with one c.iild in 
a situation where no other children'were around. 

Operant conditioners then became more venturesome and entered class- 
rooms. Many research studies were conducted which demonstrated that these 
techniques were successful when used with a single individual or a small 
group of individuals within classrooms . ^ 

Perhaps the first study of this type was reported by the Zimmermans 
(1962) . They ^used extinction' and positive reinforcement procedures to 
increase the spelling abilities of one subject and attenuate the tantrums of 
another. In 1963 Lloyd Homme and colleagues (Homme, deBaca, Devine, 
Steinhorst, and Rickert,) demonstrated that the Premack principle' was an 
effective strategy for. controlling \ wide range of nursery school behaviors. 

The work of Harris, Wolf, and Baer (1964) and others at the Develop- 
mental Psychology Laopratory at the University of Vtfashington is note- 
worthy for this extension of opei^'ant principles to group situations. They 
demonstrated in a series of studies how isolated play, crying, climbing, 
and other nursery school behaviors were amenable to the contingent praise 
of teachers* 

Several other researchers demonstrated how these principles could 
be used in classroom'^ w.-ith one or more children to attenuate certjiiin trouble - 
some behaviors . O'Leary and his colleagues (O'Leary, Kaufman, Kass, 
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and Drabman, 1970) did such ^vork, as did Becker and his fellow workers 
(Becker, Madsen, Arnold, and Thomas,* 1967). The-f^ored targets of these 
researchers were talk-duts and out-of-seats. 

Many of these researchers used the term Behavior Modification to 
describe their methodology. They had taken the vital features of operant 
conditioning — identification of an observable response, measureme/it of 
that response over a period of time, involvement of reinforcement con- 
tingencies to affect the frequency of that response — and adapted them* 
in order to study the problems oi classrooms. 

Along v/ith this rash of studies which proved that operant or behavior 
modification techniques can effectively control troublesome behaviors of 
pupils, some researchers sought to demonstrate that these techniques were 
useful in changing the attending behaviors ox pupils. Several investigato/s 
'have demonstrated that teacher praise is associated with pupil attending . 
That is, when teacher praise is arranged contingent on the attending of 
pupils, the amount of time they "pay attention" is increased, for example. 
Hall and his colleagues have clearly demonstrated in several settings that 
teacher attention can alter the attending or studying behaviors of youngsters. 
(Hall, Lund, and Jackson, 1968; Cossairt, Hall, an'd Hopkins, 1973). 

.Several researchers using Applied Behavior Analysis techniques in-- 

y 

/estigated various academic behaviors of children. One of the earliest 
,ivtempts to obtain academic measures was the work conducted by Birnbrauer, 
Wolf, Kidder, and Tugue (1965) c^t the Rainier School in Buckley, Wash- 
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ington. In their programmed learning classroom those investigators re- 
ported that measures in reading, writing, and arithmetic could be continuously 
. obtained* Arthur Staats and his group conducted several studies which 
related to the effects. of reinforcement contingencies on various reading be- 
haviors (Staat^, and Butterfield, 1965; Staats, Finley, Minke, and Wolf , 
1964; Staats, Staats, Schutz, and Wolf , 1962:). 

^ Perhaps the man who did most to stimulate the use of these pi-ocedures 
in academic settings was Ogden Lindsley, When he cutne to Kansas in 1965, 
his major objective was to adapt and extent the techniotues of behavior 
modi^\cation so that they were used to measure and change such skills as 
reading, writing, and arit^mietic. He referred to his system for obtaining 
^measurement of classroom activities as Precision Teaching! 

One of the essentials of this system is the movement cycle, ' According, 
to Lindsley, every behavior, be it academic or social, should be defined as 
having a beginning and an end. Heretofore, behaviors wer^ ofte^t counted 
on a sampling bgtsis. Every n seconc^s an observation was taken. Another, 
and perhaps his most significant contribution^^Pwas that he reinforced 
Skinner's recommendation that behaviors be measured and graphed in terms 
of freque'^xy: more specifically > movements per minute ♦ 

So it went from the operant conditioning work in the laboratories 
that was concerned with conceptual systems, tu behavior modification which 
dealt with troublesome and attending behaviors in the classrooms, to pre* 
cision teaching which emphasi-sed the measuremen*" of a wider rajige of class- 



room behaviors, including academic skills. 

In describing our research I have chosen the term Applied behavior 
Analysis. To me this is a more generic tei"m in that it subsumes ti e prin- 
ciples and techniques of the groups just referred to as well as othei s. Also, 
by operating under thi^ label, a researcher is allowed to use many tech- ' 
niques, methods of d^harting, and data gathering sys^ms; he is not restricted 
to the artifacts of- pet plirases of any sub-cult. < < 

Charagteristics .o£ A,pplied Behavior Analysis, 

Several appli^jd behavior analysts, in attempts to explain the sysl^m, 
have identified various components. One of the most widely qupted explana- 
tions w^s a paper written by Baer, Wolf, and Risley (1968) . These re- ; 
searchers described Applied Behavior Analysis by stating that it was applied, 
behavioral, analytical, technological, and conceptually systematic • 

In regard to Api^lied Behavior Analysis and curriculum research, I 
would like to characterize this system as comprising five ingredients: 
direct measurement , daily measurement , replicab le teaching procedures , 
i ndividua l analysis , and experimental con trc^l . . 

Di rect measurement . When Applied Behavior Analysis techniques are 
used, the behavior of concern is measured dii-ectly. ^ If the researcher 

, is concerned with the pupil's ability to add facets of the class 2 + 2 = [ ], 

\ 
I 

or to read words ^rom^a Ginn reader, those behaviors would be measured. 

When Applied Behavior Analysis techniques are employed, the same behavior 

/ 

that is scheduled for teaching is measured. This form of measurement is 

\ 

contracted to more indirect methods that use such devices as normative 



tests that could measure behaviors not. of immediate concern. 

D aily measurement . A second important ingredient of Applied Behavior 
Analysis is that the behavior of concern is measured, if not daily, at 
.least very often. If. for instance, the pinpointed behavior is the pupil's 
^ ability to add facts of the class 2 + 2 = [ ] , he would be given the- 
Opportunity to perform that skill for several days during; a baseline 
before a judgment is made* The reason for using sever$il days' data is 
quite obvious; it could be that on one day the pupil performed very ' ' 
poorly, the next day better, and so forth • Many times in teaching 
and research the pre- post-test methodology is used- A test is given 
before treatment and another is given after treatment ► Judgments are then 

made, based on the comparison of the two scores. Judgments or decisions 

r ' 

derived from such limited data could be pernicious; the consequence^ 
for some children could be disastrous. 

Re plicable reaching procedures . Another important feature of Applied 
* Behavior Analysis is that, generally, the procedures used to generate the 
data in research efforts are adequately described. In most instances 
they are explained i^ enough detail that other interested researchers 
might replicate their studies. By cont3:'ast, other types of research 
sometimes explain general procedures rather casually. For example, 
one B^and X iTtJsearch study that used a phonics training program as an 
intervention simply said that "Daily phonics drills were conducted. " 
It would be impossible for an interested teacher pr researcher to replicate 



these Investigations. In Applied Dcliavior Analysis research, if a phonics 
treatment was used, the reader woUld be informed not only about the amount 
of time used for instruction, but also which phonics elements were stressed, 
how they were presented, what the nature of the pupils' responses were, ^ 
and what type of feedback or reinforcement was provided. ' / 

/ 

In dividual analysis . The very heart of the Applied Behavior Analyses 
technology is that the data from individuals are presented. In fact, ^ 
some have referred^to this methodology as the Single-Subject method. In ' 
an Applied Behavior Analysis study, if data are obtained on five subjects, 
a graph of each aubject^s performance would generally be shown. In doing 

* . • i 

SO, all of the ideo«?yncratic behavioral patterns become obvious. An 
inspection of these graphs would likely reveal that although the general ^ 
effects on all five could be the same* no two graphs of pupil performance ^ 
laoked exactly alike. 

Other research systems report hie data of groups — experimental and 
control. Often a mean score is offered to explain the performance of a 
group. It could be that the average score represents the score of no one. 

It could also be that if a treatment has been used and the group effect 

» ^ 
w^s positive, what in fact happened was that the ^effect was very signifi- 

cant for some, ineffective for others, and had a slightly negative effect 

5 
i 

ok others. However, when averaged, the composite effect was.positive. 
It has never ceased to amaze me that in education, where bromides professin 
individual differences are so abundant, so much educational research is 
group relevant . 
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Experimental control . In every research study, regardless of the 
methodology, the researcher is obligated, in one way or another, to prove 
that the effects on the dependent variable were attributed to the manipu- 
lated or scheduled independent variable. He must establish a functional 
relationship. * , * , . ' 

The reason for^ such effort is extremely important. For if researchers 
recommend that method C be used by all reading teachers because the re- 
searchers found that it improved certain reading skills, they must be certain 
that variable C and nothing else caused the improvement. 

In order to substantiate their claims, the Brand X researchers often 
resort to statistical control. . Their typical research method is to form 
control and experimental groups, give a pre-test, provide a treatment for 
the experimental group and no treatment or a placebo for the control 
group, then give a post-test at the end of treatment. The pre- and post- 
test data of, the two groups are then statistically analyzed and the 
1 ^ 

winner'^.announced . The significance of the conquest depends upon which 

• r 

probability level is achieved: *05, .01, .001. * 
By contrast, the applied behavior analyst would use experimental , 
control to establish.relationships between the ind^'.pendent and dependent • 
variables. More specifically, he v/ould use some form of replication. 

- The ABA design has been tne favored form of replication. During 
the first A phase no treatment is arranged. Then a treatment is scheduled 
throughout the B condition. In tht recapitulation phase the treatment is 
removed. If the behavior changed in the B phase from the first condition 



and changed back tp'its original level in the return to A phase;' a reasonable 
"N^case^can be made that a functional relationship had been discovered. There 
are several other replication techniques available to the Applied Behavior. 

Analysis researcher, such as the multiple^baseline and crossover designs. 

* 

V . - ' SETTING AND STUDENTS 

The majority of the research that will be presented here was conducted 
. in th^ Curriculum Research Classroom of the Experimental Education Unit 
(EEU) . This research was cx>nducted over a period of several years with 
learning disabled children. 

The EEU, directed by Norris G. Haring, has bepn in operation since 
1965 and is part of the Child Development and Mental Retardation Center, 
University of Washington. It is committed to the basic notions of ' 
Applied Behavior Analysis. That is, all the important pupil behaviors 
are identified and measured daily. These data are used to make varioiis 
educational and administrative decisions. 

The Curriculum Research Classroom is smaller than the other classes 
at the EEU; smaller than the usual public school classroom . The staff 
includes myself, a head teacher, a research assistant, and a few graduate 
stiidents. 

For the past several years we have chosen, as a research population, 
elementary age children, ages 8 to 12, who have been identified as 
learning disabled. Each year we have had six or seven/children in the class- 
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Before entering our class, tHese children attended either regular 
or special classes. Of the 35 children who have been in this class, 14 
came from special classes. We have had only two girls in this classroom. 
Generally, their I.Q- scores (for whatever that is worth) have been in 
the normal range: from 80 to 115. Academically, the children we have 
selected were achieving^below their peers in reading, some by as much as , 
three years. Most of the children had related language arts deficits; 
they were relatively poor in spelling, composition, and penmanship. About 
half of them were below average in arithmetic computation. 

Socially, with few exceptions, these children were quite normal. They 
could carry on conversations about their homes, pets, hobbies, and sports 
! as well as most other children their age. Few of the pupils were behavior 
problems; they have generally not been naughty children. I must add,, . 
however, that many were referred because of behavior -problems 'ift addition 
to their academic deficits . ' < , . * 

These children were as healthy as their non-£EU peers. Although . 
they were absent a few days because of tpnsil infections, colds, and flu, 
their absentee rate was no higher than wo^ld be expected of children their 
.age. The same proportion of these children wore eye glasses as Woi^ld be 
expected; ' none of them wore hearing aids , None of the children were 
physically disabled. Of the 35, about six were on .some form o| medication 
while in our class. 



In regard to speech, only two or three of the children displayed, 
even mild, articulation problems. One pupil's speech was somewhat gai"bled, 
but this was due to a combination articulation, rate, and ghettoese problem. 

The children v>ere from middle to upper-middle class homes. Some 

7\ 

of the,ocpup?tions of their fathers were university football coach, 
Boeing engineer, physician, high school teacher, construction worker . 

Each year we begin with a different group of children. The pupils 
stay in our class for four academic quarters. They are then returned 
to thpir original school systems. Most of them gone>back into' 

regular classes, although some were placed one or two grades below th^ 
age peers. ' * ^ 



RE:SEARCIi 



In this section, research^will be explainqd by subject matter area: , • 
reading, arithmetic, spelling, communication, and pupil management. Many 
o^the Studies described here, have been published in Various educational 



or Applied Behavior Analysis journals. The complete articles will not , 
be included; each project will be greatly condensed. Hopefully, , . 
h(\jveyev, ..enough ihformation will be provided so that interested teachers^ 
may be able to apply some of the findings or techniques in their classes, 
and curriculum researchers niay replicate certain of the procedures^ 
For those who would like to read the entire reports, References. are included 
(see footnotes 1 through 13) . • • 
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Traditionally, there haS been a research implementation gap, Re- 

^ J ' * • 

searchers have bemoaned the fact, teachers have not readily incorporated 

their; findings, There ai-e many reasons for this lack of, rapprochement ^ 

\ • 
between researchers, and teachers. I belicv^e the primary reason, „ however, 

, that accounts for the absence of extrapolation from research settings to class- 

* , • o ■ 

rooms is -that many teachers and researchers have generalization deficits/ 

When ^cme teachers read research they are.unable to extract elements that 
could l)e implemented in their classes. They tend to view generalization 
as an all or nothing proposition . If they can not incorporate everything' 
that v/as us'ed by the researcher, they Will not accept any of it. a . 

' Similarly, many researchers, when describing their investigations 

tend to con\^ey the idea that their study should be generalized lock, stock, 
and barrel. Rarely do they suggest lhat 3Qme teachers in cpecific situationc 
use cetttain of their techniques or findings. 

Throughout this chapter I have attempted to respond to this generalization 
^' dilemma. Foil-wing each research summary in this. chapter f have included a 
brief section entitled "To the Teacher .■!' In those sections 1 have discussed ' , 
. several features from the research that teachers might consider u "ng 

m their classes. These' are specific recqtnmentaitons that pertain to materials, 
instructional techniques, me'asureigent, performance analysis, performance' 



, objectives, and learning principle^. 
Reading Research ^ " i ^ * 

Effe cts of phonics instfuctioji on oral reaciinp; / Perhaps no other 



than the is^ue of phonics traindng. Somd^ reading experts have stated categor- 
ically that pupils must have ^n extrQrri^ly good phonics background before 
formal reading instruction commences. Many .of them argue that unless 
the pupil is provided with systematic part-word training, he will be lacking 
certain word attack skills and hence will not become a proficient reader. 
Other reading experts are iess impressed by the arj im.^nt that phonics 
skills will transfer to other, morfe complex reading behaviors. They maintain 

i 

that the English language is so irregular that it is fruitless to teach phonics 

rules and generalizations . They recommend, therefore, that reading instruc- 

r 

ticn be more direct, that pupils should be taught words rather than word 
elements * 

As is the case with most controversies, extremists are rare in reference to the 
♦.vhcle^ part- word argument. Most teachers have taken moderate approaches on 
the matter. They see merit in teaching certain phonics generalities along with certain 
t^:^xeptions and some whole words. Nevertheless, even though most reading teachers 
do not take radical positions on this issue, the controversy persists. 

The research described here was designed to bring data from an Applied 
Behavior Analysis aoproach to bear on this topic . We sought to obtain data 
regarding two questions; a) if the phonics skills of a pupil are improved, 
will his ability to read orally increase; and b) if his phonics skills improve, 
will concurrent gains be noted more in a phoniqs or a non-phonics designed 
reader ► 

The subject in this research was a lO-year-old boy.^ He had been 
described as dyslexic . Daily measures were obtained from this boy in seven 

/ 
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areas: five phonics skills and two in oral reading. The fivephanics skills 
erfmljasized medial vowels, consonc it blends, ^pum* blending, translocation 
of letters, and digraph-diphthongs. In oral reading the pupil read from 
a Li'ppincott and a Ginn reacier. The former reader was designed primarily 
on phonics principles, the latter on the whole-word method. 

To assess the boy's performance in the phonics. areas, five word sheets 
were constructed. The mediaJ vowel sheet contained a list of 20 three- or' 
four-letter words. Each word contained a short medial vowel. The consonant 
list was made up of 20 words, each beginning with a different consonant 
blend. The sound blending list contained 20 consbnant-vowel-consonant 
words. The translocation list comprised 25 words that contained letter combina-' 
tions that are potentially transposable (flit, clap, spbt ) . Thexiigraph-diphthong 
sheet was made up of 26 bets of words. Each set featured a different combination, 
e.g., ee or ay . ' . , / 

A correct response for the medial vowel and consonant blend tasks ^ ^ ^ 
was the accurate writing of only the vowel or the blend. A co^^rect response 
for the sound blending, translocations, and digraph-diphthong tasks was 
the correct spelling of the entire word.' A correct oral reading respoijse 
was the correct pronunciation of a word. Errors consisted of omissions, 
substitutions, and additions. 

Correct and incorrect rate scores were obtained in each of the seven 
tasks. To obtain these rates the teacher timed e*ach performance, e.g. . 
medial vowels, and counted the num^ber of correct and incorrect responses. ^ 
She then divided the number correct and the number of errors by the'timc 
Q requireid to complete each task* ' < ] ' • ^ 



An AB design was used for this research, baseline, and intervention. 
During the baseline period the pupil was provided with feedback on ais 

phonics performance. Whefi he responded to the five sheets the teacher 

'> ' 

corrected his papers and pointed out what errors were made and told him 

s ' 

" * 

the correct responses. Meanwhile, throughout this baseline phase, no insti-uc- 
tion was offered as /he read orally from the two books. As he read, if h^ 

. ■ ' ■ • ^ ■ ■ ■ 

erred on certain words, the teacher merfely sujggested he continue reading. 

Throughout the next condition instruction was scheduled. Prior to 
obtaining the seV^n measures a 10-minute instructional period was, arranged. 
This instruction was bas^J the Slingerland teaching procedures which '* 
emphasized the principles of multi-sensory instruction. Some instructional 
time was devQted to each of the five phonics elements. No insti action was 
focused on oral reading. Reliability checks w^re made during both conditions 
of the* study for each measured behavior. These chepks pertained to timing, 
accuracy of marking the-responses, and general procedures. 

Three rather important findings cameirdm this .study: a) when phonics 
skills were precisely defined. and when instruction was djjt^cted toward them. 



those skilly were improved; b)»when phonics skiDs improved, so did oral 

reading rate (correct rates increased," incorrect rates decreased); and c) 

more improvement was noted as the pupil read from the phonics reader than 

from the nan-?phonics reader. 

In regard to the last point, Figure 1 is provided to illustrate the changes 

in oral reading rates across the two conditions for both readers. The data 
»i » 

s 

from the wholerword book are on the left portion of the figure, and fi;om the 



phonics book on the right. The vertical lines in both portions of the ^hart 
separate baseline and instructional phases. 



Figure 1 about here 



One way to compare the data from both books is to contrast median 
scores. The correct rate median gains were greater for Lippincott than for 
Ginn. Likewise, the incorrect rate median gains were greater lor Lippincott. 
Another way to compare the data is to contrast trends. An inspection of 
the correct rates across conditions in the Ginn reader revealb that the trend 
of those data was only slightly more acute during the intervention than the 
baseline phase. By comparison, the differences in the trends of the correct 
rate data in the Lippincott text are, greater. When error rate data across 
conditions are studied, the treads in the Ginn book are about the same. 
However, when the errors in Lippincott are analyzed, the trend of the inter- 
vention phase was downward, whereas the trend of the baseline phase was 
upward. , . . ^ 

\ ♦ 
J 

"To the Teacher." There are at least three points from this study 
the teacher might consider . One important notion is to carefully define instruc- 
tional procedures. In thi«? project Slingerland techniques were used; not 

0 

only were they precisely defined, they were consistently used. 

Another point from this study is that pupils should be required to 
respond to the same material during a project. Daily, throughout this study 
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the ^pupils responded to five word lists that were the same. Had those materials 

varied from one day to the next, the teacher would not have Unown which 

p'articular words were learned and would therefore, not have known whether 

I 

her instructional technique was effective. 

A further item to consider from this project is that often, in order 
to monitor the development of advanced skills such as "creative writing'' 
or "reading,'^ several sub-skills related to that major skill must be measured. 
In this report seven measures were obtained daily: five in phonics, two 
in oral reading . . ' 

i 

C omparison of measurement that is direct and daily with achievement 
test score s 2 Perhaps the most widely used technique for evaluating pupil 
progress is the achievement test. In many school systems an achievement 
test is given at the beginning and the end of the year. Achievement test 
scores pertain to such skills as reading, spelling, and arithmetic^ 

These scores ar^ugedjpr various purposes. Sometimes they are 
considered to document teacher competency. At other times they are used' 
to make placement decisions; whether to assign students to special or regular 
classes, high or low reading groups, or to one grade or another. At other 
times they are used for purposes of co^nmunication, to report pupil progress 
to teachers, administrators, or parents. 

The two important evaluative dimensions that are void when achieve- 
ment tests are use^j are direct and daily measurement. Often the achievement 

X 



test measures a behavior thai ib only indirectly related to the behavior of 
concern. And inevitably the achievement test provides an infrequent measure 
of performance, for gAierally they are given once or twice a year. 

Although for some years v/e had expressed these criticisms about 
achievement tests and sti-ongly recommended that they be replaced by direct 
and daily measures, we did not know how disparate the two systems were 

in rcgiird to describing performance ► Our criticisms were not substantiated 

/ • 
by data. Two years ago^ therefore, we arranged a situation to compare 

the efficacy of the two systems'', acJiievement test and,4ii:^ct and daily 

K^easurement. \ ^ 

At the beginning and the end of the year we gave oyr pupils the 
Metropolitan Achievement Test (MAT) and the Wide Rang? Achievement Te st 
(WRAT) . Throughout the year we also obtained direct and daily data from 
the children in reading, writing, spelling, and arithmetic. At the end of 
the year we then compared the reading subtest achievement test scores with 
the reading data obtained from direct and daily D#asuremont. Several dif- 
fcretices between the t>jvo measurement systems were evident. 

First it was discovered that the achievemeYit tests did not agree among 

themselves. The fall test^isagreed ^ore than one~half. grade level for 

three of six children. The most discrepant scores were obt£ftned by a 

pupil who received a 2.4 rating on onp tost and 4.4 on the other > The 

t 

scores of the two tests in the spring disagreed four out of six times. 

The widest differences for a puoil onUhe two tests were 4-0 and 8.7. 

i 

In regard to placement we compared the actual initial placement of 



pupils when direct and daily measurement procedures were used with their 
fall achievement test scores. Using our method of placement we required 
each child to read several days from a- number of readers representing 
different grade levels. We graphed correct and incorrect rate perfor- 
mances as they read from these texts. After several days we analyzed 
the data and selected initial readers for the children based on their 
relative performance. Only three of the six placements, according to direct 
and daily measurement, agreed within one-half ftrade level with an achievement 
test score. A compar^ison of the book level they were actually reading in 
at tha end of the year with their spring achievement test scores revealed 
concurrence betwe -^n achievement test and actual placement foi^r out of 

\ - • - 

six times. , . 

In regard to the data about pupil grov^th throughout the year, all the 
pupils gained when the MAT score was considered. Their spring scores were 

all higher than their fall' scores. According to the WRAT, however, there 

/ 

was no growth for two pupils and a deterioration lor another. When direct 
and daily measurement was consider d> all children improved. Furthermore, 
this improvement was indicated in three v^ays: their correct rates increased 
from fail to sprirxg, their incorrect rates went down, and they read from 
inore difficult material in the spring than in the fall. Achievement tests 
provided only a. grade level difference score as a measure of improvement. 

A final advantage of direct and daily measurement over achievement 
test measurement must be emphasized. When the former system is used, a 
teacher can see from one day to the next whether progress is being made. 
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If the data indicate the child is not improving, a different teaching 
routine can be scheduled immediately. By contrast, if a teacher waits 
until sp;ring,to discover whether or not her teaching was effective, she 
would not have time to re-design her instruction if the pupil was tailing, 

"To the teacher." Tfcis project clearly points out the results of 
using indirect meas\'res such as achievement tests. That is, pupil scores 
on achievement tests are not always correlated with their performances 
in the classroom. The report*also suggests what can happen when per- 
formance is measured infrequently. Since all behaviors are variable, any 
educational decision made from one or two samples could be inappiropriate; 
the consequences, for the child, coulS^be less than desired. 

This study also urges teachers to place students in readers based 
on their daily performance from classroom materials, and to use direct 
and d^ily procedures to communicate progress to parents and teachers,. 
Further, this study strongly suggests that teachers use pupil data to 
evaluate all instructional techniques that might be. scheduled to improve 
I'eadmg . 

Another aspect of this study which merits consideration deals with 
communication. Many teachers, particularly special education teachers, 
have used direct and daily measurement data to communicate children's 
growth to their parents . They have found this method of comtnunication far 
superior to other styles because of its objectivity and individuality. 

A final note from this study pertains to the widespread and current 
practice of usitig^ achievement tests to evaluate performance contract 

ERIC ; ::j 
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situations and teacher performance. Many teachers have been critical as 
to the use of achievement tests for these purposes. Unfortunately, when 
asked for alternative evaluation strategies, many are unable to respond. 
The method for evaluating reading in this study and other academic skills 
throughout this chapter- -direct and daily measurement—shoulifl'be seriously 
considered as a replacement'for 'achievement tests, 

Effects of various reinforcement contingencies on oral reading 

3 

rate. The research presented here comprised three studies. In each, 
the effects of a reinforcement contingency were investigated. In two 
of the studies the contingency was arranged for correct responses and 
in one, for errors. The reinforcer in these studies was leisure time. 
Pupils, during certain conditions, were able to earn minutes of free time. 

In each of these studies correct and incorrect rate data were gathered. 
Incorrect responses were additions, omissions, and substitutions. The 
studies shared other common features. As the pupils read, some feedback 
was provided; if a 'word was mispronounced or left out, the word was pro- 
nounced by the teacher. Comprehension data were obtained in all the studies 
in addition to the oral reading data. Reliability checks were also obtained. 
A second observer monitored some of the sessions and checked the teacher's 
timing, counting, and general procedures of the experiment. A final feature 
included in all of the projects was that each pupil read daily from two 
readers. One reader was used as the experimental text, the other as a 
control. In the conditions where a reinforcement contingency were 
scheduled, it was associated with only the experimental text. No intcr- 
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ventions were scheduled for the control reader. 

In Study 1 an U-year-old boy read orally for five minutes each day 
from two readers. The experimental reader was a Bank Street text, whereas 
the cpVtrol reader was a library book. Encyclopedia Brown Saves the Day . 

This project used an AB design. During the first condition neither 
iitstruction nor reinforcement contingencies were arranged. Only a type of 
feedback was in effect. Throughout the second condition ^ reinforcement 
contingency was arranged. The requirements of this contingency wire that 
if, after the five-minute reading period,' his correct rate was equal to 
or exceeded 50 words per minute, he was granted poi^Ufs^n a 25:1 ratio 
(for each 25 points he earned one minute) . 

When his performances in the two conditions were compared, it was 
revealed that, on the average, his correct rate improved by about 12 
words per minute from first to second condition, while his error rate was 
reduced about one word per minute. His reading rates throughout both 
conditions in the control reader were stable, hence unaffected by the 
contingency. 

In the second project the pupil was a 9-year-old boy. Daily, he read 
from a Bank Street and a Merrill reader . The former text was designated 
as the experimental book; the later, the control book. The project used 
an AB design. The first period was the baseline; during the second con- 
dition a contingency was arranged* for the experimental text. The contingency 
focused on errors and involved a withdrawal of points. Each day the pupil 
was given, non-contingently. 15 points. The points were then taken away 
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on a 2: 1 ratio, for every two errors one point was withdrawn. At the 

s 

end of the reading session the renlaining points were redeemable for minutes 
of free time . 

The results of this project revealed that the student's incorrect. 
^ rate improved from one condition to the next. However, his correct rate 
across conditions was' unaffected. His rates in the control text were un- 
changed across conditions. 

In Study 3 the pupil was an 11-year-old girl. The two readers were 
from the MacMillan and Laidlaw series. The MacMillan book served as the 
experimental reader. 

This e^cperiment was composed of four phases; an ABA design was used< 
In 'the first and third conditions, feedback was provided as the girl read. 
Neither instructions nor rveinforcement contingencies were arranged. 
Throughout conditions two and four, a 30: 1 ratio for correct responses was 
scheduled. For each 30 correctly read words, one point was given. 

The results of this project indicated that, generally, the girl's 
reading performance was superior throughout the conditions of reinforcement 
to those phases performed without contingencies. In Conditions 2 and 4 
her correct rates were higher and her incorrect rates lower than during 
Conditions 1 and 3. Her correct and error rates, as she read from^he 
control reader, were stable thi-oughout all conditions. 

r 

^ - As a result of the reinforcement contingencies, improvement was 
noted in all three studies. Of perhaps some interest were the specific 

4 

effects of the contingencies in Studies 1 and 2, In Study 1 the contingency 
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applied to correct responses; in Study 2 the contingency was arranged foi- 
errors. In Study 1 correct rates were influencecLn^re than error ra^tes. 

In Study 2 errors were fyiore influenced. 

« * _^ - , ' 

"To the Teacher Many procedural features from this study could be 

used by teachers. First, the time|for reading instruction was rather brief, 

about 15 minutes per day per child. It has been our experience that when 

good material is used, when the ongoing reading procedures are satisfactory, 

and when effective teaching techniqifes are used, pupils thrive, even though 

the reading periods are short . *^This, sholild be rather Encouraging to teachers 

y ^ ' ' . , 

who have several children in their classes, and yet want to ivxdivijiualize 

their programs. 

4 ' - 

Another consideration from this study regards the use cf two readers. 

Classroom teachers may not be as concerned with the coiitrol feature of the 

.\ , ^ 

second reader as we w#*e. However, a teacher might want to use two readers 
for a different reason; perhaps for generalization purposes. She could 
have a pupil read from two texts and arrange some teaching technique such 
as drilling on errors for, only one reader. By obtaining data from both 
readers the teacher could determine, first of all, whether the technique 
influenced the reader it was associated with, and second, .whether the 
effects transfered to the other reader . 

Teachere should note the various ways contingencies were arranged in 
this repon. Pupils c^^n be given something for a certain type of performance 
or they can lose seething' defending on their performance. They could 
gain points for correct responding and lose for errors. Reinforcement 

9^. * , . 



-^Tsy stems tiave -further flexibility since the gain and loss ratios can be 
adjusted , A pupil could gain points on a 5: 1 ratio (one point for five 
correct responses), or the ratio could' be det at 500: 1. The possibilities 
are infinite. Another dimension of the reinforcement system is the event 
that is either gained or lost. Such events in the past have been points, 
minute^ o^ free' time,, models, classroom privileges, recess.' 

^ . Effects of previewing on, oral reading; . Whereas the previous study 
' ' ' ■ ^ ^ ■ ^ 

' investigated reinforcement contingencies as- they influenced oral reading, ^ 

Xhis experiment dealt with non-contingent interventions. These non- . ^ 

contingent events v>ere thre^ types of previewing:\ oral, silent r and teacher 

previewing. 

Various forms of previfgwing havmjeen Aise^' for -years by teachers of 
reaeding. Publishers have recommWid«ii this approach £^s a method for teachj^irg 
fluency. In spite of the widespread use and support of this technique, ^ • 

little research on *he topic is available. 

Two studies that used three types of previewing will be presented. ' 
In both studies the general procedures were the same. The pupil read 
orally ^E^r^wo minutes daily. Feedback regarding mispronounced or omitted 
words was^Wided throughout the studies. In both studie^s reUability. 
checks v/ere obtained regarding timing, accurate monitoring of responses, 

f 

and general operating procedures. 

In Study 1 the pupil was a 10-year~old boy. He read from a Lippincotl 
reader each day. This project consisted of five conditions and used an ^ 
' ABA design. Throughout Conditions ], 3, and 5, only feedback was scheduled. 
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* V ' During the previewing tonditions the pupil was requested to read orally 
the material he would again read orally. The first reading was considered 
as practice, the second the "real". performance. Throughout the'fiirsr reading 
' the pupil was coached on difficult words; this was not the cas,e when he rea.d 
a second time. Only the data from the second reading were grajphed. 

These data indicated that oral previewing had substantial effects on correct 
rate. Although his incorrect rate maintained across the various conditions, 
his correct rates, during previewing conditions, were nearly double those 
rates when previewing was^ot used . . , 

In Study. 2, two types of previewing were used— silent previewing anc| * / 
teacher previewing. The subject in this study was nine years old. He read 
each day from a Lippincott text. 

This study^ used an ABA design for both types of previewing . During / 

♦ ** . 

the first condition only' the feedback procedures previously described were 
in effect. Throughout the second phase,, silent previev/ing wafe scheduled. 
Prior to reading the story orally, the boy read it silently.. As he did so. 
he could ask the teacher for unknown words. ^ In the third condition the 
previewing technique was not included. These data indicated that the 
technique greatly influenced correct rates and mildly influenced incorrect 
rates. 

The next part of the study investigated the silent previewing technique . 
\ Following the baseline phase, .which was the final condition of the first 
part of the study, the teacher read to the pupil the material. that he/sub- 
sequently read orally. Throughout the next condition no prev^ewihr was 



u?ed; then, in the final or fifth condition, previewing was ag^* . inst^- ' 



tuted 



In comparing the dat<i from the final three conditions, it was apparent 
♦hat although incorrect rates were not affected across conditions, correct 
rates were substantially altered. t)uring the teacher previewing ^^condition 
the pupil's correct rate was nearly double that prevailing di'^-ing non- 
previewing conditions . ' ^ 

"To the TeacherV In this report, all types of Dreviewing were 
eiiective. Their greatest effects, however^ ^were on correct rates; 
incorrect rates were not significantly impro^)^^r 

Therefore, if a pupil's rate of comroitting erroVs is too hig'h and the 
teacher desireii to concentrate on i-aducing them, she should porhaps 
select a tactic other than previewings She might choos'e to drill^the pupil 
follo^.^ing each reading assignment on the errors he had made, Or,.^he 

n^ighi design a technique that focused on somp particular error pattern of 

■ti . , 

the pupiL However, if the teacher's goal is to improve a pupil's fluency — 

? 

*^his correct rate — one_of the types of previewing used here could be appro^ 
priate. 

We have invctstigated other types o' previewing, such as allowing tne 
pi ' to listen to a tape recording of the story he will read. In another 
pr^^rct wc recorded on language master pards phrases from the story the 
pupil would subsequently read. Ajlter he listened to the phrases he read 
th<* compU*te story, insofar as increasing fluency, all these pj-eviewing 
techniques have gene*-aliy been effective. ^ 



Rekttionship of oral rcadiug&ncl comprehension . In th^ previous two 
studies the major conc(>irn was the measurement and dev^bi^Dmen^ of oral reaijiing" 
In this study, although oraF reading, was again of primary concern, equal 
emphasis was directed toward silent reading and answering comprehension 

questions. X . * 

' *■ ^ ^ ' 

I . ;^ 

This ^tudy ran for three quarters. D^ily, four measures ^ere*obtained. 
The measures pertained |o oral reading, ans\Vering comprehension questions 
from orally read material, silent reading, and answering quesj^ions from' 
material rea^ silently; Thiroiighout t first two guartei s the pupils read 

' ^' 

orally^ from a Lippincott reader arvd silently from^a Ginn text. T^ie tv/c 
rijaders were matched as to reading difficulty. Tha' is, as the pupil read 



y from the two texts for a few days,, his rates in both texts were 



about the sariie. . : ** . < . ^ \ 

■ s • V - - ^ r 

Each day the pupil read 500 words oral^;^ in a Lippincott reader, then 

* ' - '* 

N^nsweredBO comprehenrsion qUestionf * As the pupil jfead; the teacher supplied 

missinc ancf.misoronounced words. He then read 500 words sil&ntly a Ginn 

reader and answered 30 comprehension.questions No feedb -ok was provided 

for silent reading. The comprehension questions were of three 'ypes: 

interpretation, recall, and sequencing. 

Followinj> a baseline periocl where neither in^atruction nor reinforctjment 

contingencies were in effect, the class was split into two groups. With one 

group a contingency was scheduled for oral reading rate; for the other, the 

contingency was arranged for the comprehension of orally read material . 



ERIC 



-31- 

The contihgency was based on progre&s and focused on errors . In oral 
reading a projected trend was drawn on the graph. If on any day a pup'l^s 
oral reading rate was lower than that slope, he had to practice the words he 
erred on. Each error was embedded in a phrase; for several minutes he prac- 
ticed reading those phrases. In comprehension a similar projected trend was 

drawn .^If, on any day a pupil's comprehension score was below the line, 

— J 

he had to re-do the questions he had incorregtly answered . 

A crossover design was used for this research. During the first quarter- 
.the contingency wat in effect for some of the pupils for oral reading, 
and^for other pupils for comprehension. Throughout the winter quarter 
the project was conducted again. The only difference was that the groups 
were alternated. Those who were in the oral contingency group in the fall 
werV now in the comprehension group . 

The project was run for a third time in the spring quarter. At that 
time the mode of reading the texts was switched. Lippincott now became 
the silent reader and Girn the oral reader. Dming that quarter both con- 
tingencies were alternately arranged for all pupils. If, during the first 
part of the quarter a pupil was in the group where the contingency was on 
era) reading, he was, in the second half of the quarter, transferred to tue 
group where t' . comingency was on co^ prehension, 

Reliability checks were scheduled throughout the year. These checks 
focused on timing, accurate c hunting of responses, and general procedure • . 

Sevorai findings from this research should be noted: a) v/hen UlC con- 
tingency was arranged for oral reading, tha' performance imprrved; b) when 
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the contingency was arrange d for oral reading comprehension, that performance 
improved; c) when the contingency was arranged for oral reuding^ oral 
reading comprehension was unaffected, silent reading and silent reading 

f 

comprehension* improved, and d) v. hen the contingency was arranged for oral . 
reading comprehension, ora. reading improved, silent reading and silent reading 
comprehension improved. The biggest gains were those indicated by points 
a and b. ' 

"To the Teacher." Teachers could consider some procedural matters from 
this study. Throughout this project the pupils read 500 v;ords each day orally and 
silently. This seemed to be a reasonable amount; the pupils uere generally attentive 
and they read enough material so complete story or a large portion ol a story was 
covered . 

« 

Other projects discussed in this chapter were scheduled by time, that is, 
the pupil read two or fiv^» minutes each day. Whether the teacher prefers that pupils 
read a fixed number of words or for a certain period of time each day, she should 

V 

settle on one method or the other . If the situation is not stabi listed in respect 
to amount or time, the data from one day to the next will not be comparable. 
Some teachers are, however, dissatisfied with both options because they 
want children to road complete stories. One way to schedule un Torm timt:s 
or amounts and also allow pupil.^; to finisn their i>torics is to have them read 
beyond the point of timing. If, for^ example, the teacher requires the pupil 
to read for five mmut ^^s and at the end of that time a haif page remains of 
the story, she could make a m^,''k at the fivc-minute poi^^ t, and let him continue 
reading until a logical conclusion i.s reached. Tlie data from the five-minute 
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reading could be recorded, thus providing, the te^acher with a reliable rneasure 
since the same unit of reading was measured each day. ^ . 

*'From this ^xsroject teachers could al^so consider the instructional technique 
that was used and the way it was scheduled. First, the instruction for oral 
reading amounted to requiring the pupil to rehear^se his er^ed words embedded 
in phonics; the procedure for teaching comprehension merely required the 
pupil to correct his incorrect answers. Second, insti'uction iox, oral reading 
or answering comprehension questions was^ scheduled only wWn the pupil 'ItT^ 
performance was unsatisfactory. If his performance was adequate he received - 
no instruction, 

A final point to be considered from this project ijj that teaching should • 
be focused on the behavior of concern. In this project the greatest oral 
reading and comprehension gains occurred lur.ng those phases when a 
teaching technique was directed toward those behaviors. Although generaliza- 
tions sometimes occur, as noted in the firiit reading project, the teacher 
should stil] direct her attention to the immediate behavior of concern, racher 
than a related skill. 

Arithmetic Research ^ 

I I — ■— ...» jr. 

!Li5iBgJi?}_^i}l^:9..*I^^ subtraction. In the early 

days of behavior modiiication and Applied Behavior Analysis, behaviors 
were altered almost exclusively by reinforcement contingencies. Since reinforo 
such as tokens, praise, or candies were always presented cfter the designatpd 
behavior occurred, tl oy were referred to as subsequent events. That many 
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subsequent events functioned as reinforcei s has been amply denSlohstratcd . 
Some reinforcement theorists have^^boasted thai, if Aicy can find a reinforcer 
for a given individual they can t^h him several, skills. 1 certainly would 

not contest such a claim — relnforcers are ^ere to stay. ^ ^ * " 

» . ^ # f * 

However, behaviors arc altered in other ways* Many times the events 
thai come before the behavior Occurs are influential. Certain antecedent 
events have long been used by teachers ana parents in their efforts to mstiruct 
children. M^ny of those, events are reported this monograph; for example, 
previewing, modeling, and verbal instructions . 

The'e::periment briefly described here was one* of the initial Applied 
Behavior Analysis research efforts that investigated the effect of an event other 
than a reinforcement contingency. The experiment comprised three studies; 
each used an ABA design. The pupil in the experiment was ar. 11-year-old 

boy. 

Study 1 consisted of three conditions. Throughout >the study the boy 
reqxiired to perform 20 problems of the type [ '] - 2 = 6. In the baseline 
phase he received no teaching, feedback, or reinforcement. When he finished 
the 20 problems, he v^as thanked and sent on to another academic activity . 

During the second condition, he was required to verbalize each problem 
before he wrote the answer. He sa^d, for instance, "Some number minus 2 
equals six." He then wrote the answer . The teacher monitored his behavior 
during this phase and reminded him occasionally to verbaii::c each response. 
During a third phase, he was asked to refrain from verbaliziag the probler^s 
and answers. ^ 



r 



■35- 



* / 

The data from this study indicated that^his performance vvas far superior 
in the condition where verbalization was required than during the baseline 



/ 



phase; when no verbahxation was demanded. Further, his performance .maintained, 

even improved, in the. final condition when verbalization was no longer practiced. 

Two other studies like the first were carried out. In t^^ secohd, problems 

of the type ( ] 20 = 40 were used. The probleir.s in the third study were like 

4 - 3 = 9 ~ [ ] . Both of these studies comprised three phases^ During the first, 

no verbalization was required. The pupil i;gj^balized each problem and answer 

throughout^hase 2; then, in the final phase, he no longer verbalized. 

^ I ' ^ 

The results of these studies were identical to those of Study 1 . During 

the baseline phase his correct rate and accuracy were low, then much improved 
in the^^'lecond phase. In^the final condition the behavior of subtracting was main- 
tained, in spite of the removal of the cue. 
i 

o 

''To the Telfeher." The experiment demonstrated that a technique that 

ha^ been used for years by teachers and parents can be *=^.^C^-vive. Many 

teachers have encouraged 1;heir pupils to think before they make a response. • 

\ . . V 

Mpre importantly, this experiment demor^rated the inclusiveness of Applied 

Behavior Analysis techniques. Clearly, all the teaching variables used. by * 

teachers for years--modeling, various aids, anj^ mnemonic systems — can ue 

evaljUated withm the Applied Behavior 'Atnalysis framework. These events ^ 

canX^ easily be subjected to analysif^as the many reinforcement variables 

4 

fliat have for so loi;ig been monitored by this system. 
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This project, like several others, emphasized the idea of using consistent 
materials. If a teacher, wishes to teach a specific skill » she must define th^t skill, 
th^n provide the pupil with materials of that type. Often teachers^are frustrated 
in their attempts £o teach specific arithmetic skills from comme^rcial texts. The 
items in some texts vary considerably from one page io another. Teachfers who 
wish to teach pupils to be proficient with specific skills are, therefore, forced 
to construct their own-^arithmetic sheets. When it is necessary to prepare 
supplementary materials, vthe teacher should first defin^ a specific class of 

problems to teach (e.g. , addition problems where the addends are from 3 to 9 

t 

and the sums from 6 to 18) . Next, several sheets whigh contain problems 

/ 

of this type should ^e made; the same number of problems should be on each 
sheet. The teacher may also want to use all different problems on a sheet and 
different arrangements of problems from one day to the next. 

The sequencing of phases in this report merits some consideration. Eacji 
project in this report conbisted^of three phases. During phase one — baseline — 
it was confirmed that the pupil needed assistance. During phase two--when 
tl/e verbalization technique was schedule<^--he improved. During phase 
three- when the technique was removed — his behavior maintained . This 
arrangement of phases should be the most oopular teaching design; for not only * 
does it allow the teacher to ascertain the effects of her teaching technique 
(phase 2), but it allows her to view how well the pupil's behavior maintained 
when the technique is taken away (phase 3) . 

Another feature to be brought out from this project could be offered as 
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a warning, "don't allow a teaching teclrt,'ni.que to be used too long. " In this 
project, although the pupil reached favorably when the technique was scheduled, 
he ijnproved even more when the technique was removed. Although the teaching 
technique was initially- necessary , had it been left in too long subsequent growth 
would have been inhibited. 

Use of modeling to influence acquisition of arithmetic skills *^ The 
instructional technique used in this study is perhaps the oldest and most widely 
used technique available — showing and telling someone how to do something . 
Many times teachers, in their efforts to assist pupils to compute certain types 
of arithmetic problems, go to the chalkboard and demonstrate how a problem 
should be solved. As they go through the steps of the problems, they verbalize 
the process. Sometimes the sample problem is left on the board as the children 
complete their assignment. 

This experiment comprised three studies. Tliroughout, ABA designs 
were used. In Studies' 1 and 2 the intervention involved the demonstration of 
a problem, then leaving that sample as a model for the pupil to consult. In 
Study 3 components of that technique were investigated. Reliability checks 
were obtained in all three studies in regard to timing, accuracy of marking 
responses, and general procedures. 

In Study 1 the pupils were assigned different types of problems. Some 
were presented problems like 470 249 = ( ], others, multiplication problems 
like 22 X 13 = [ ] and 8 x 0 = [ ]. During the baseline phase the pupils 
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received no instruction, feedback, or reinforcement. They worked for tv/o 
minutes each day on the sheets. 

Throughout the intervention condition the modeling technique was used. 
The pupils were shown how to do a problem of the;^ssigned type and that model 
was left on their sheet. They could refer to the moael at any time. The data 



throughout this condition revealed that rapid acquisition occurred for all pupils. 
Furthermore, throughout the intervention phase their scopes were nearly all 
perfect. In the final condition, when the modeling intervention was removed, 
their scores, with few exceptions, remained high. 

Throughout Study 2 the pupils wt^re assigned different problems than 
those used in the first study. Again a baseline phase was scheduled. Their 
performances were generally 0% throughout this period. Next a feedback inter-- 
vention was arranged. Following the completion of an assignment the teacher 
marked each pupil response as correct or incorrect. This checked paper 
was handed back to the pupil. Since the students could not do many of the 
problems, most of their responses were Marked as errors. None of the pupils 
progressed during this condition, although the procedure was in effect jfor 
about seven days. 

In the third phase, the sam^s modeling technique used in Study 1 was 
scheduled. The results of that period were as impressive as those revealed 
in Study 1; effects were immediate and lasting. When the intervention was 
withdrawn, the accuracy of the pupils continued to be good. 

m Study 3, eiexnonts of the modeling intervention were used. Throughout 



this study different problems were again assigned. As in the othei two studies, 
the pupils worked two minutes each day on the problems. In the fi *6t phase 
no teaching was scheduled. During th« intervention phase the mocel alone 
was used for some of the pupils. The sample problem was placed o. i their 
work sheets, but they were hot shown how to perform the problems. - For other 
children, during the intervention period, onlv the demonstration wa; provided. 
The teacher showed them how to do a sample probleiTi, then took awa^ the 
model . The pupils were unable to refer to the sample as they worked the problem 

The results of these efforts indicated mixed success; for some pupils 
this partial te.,hnique was effective, for others it was not. Since the total 
technique --demonstration and permanent model — required about two minutes 
of instructional time, it was recommended that the whole inter /ention be used. 

"To the Teacher." There are a number of features from this report that 
reinforce notions presented in other projects. For one, this report illustrates 
again how arithmetic problems of certain types can be taught as a group. For 
another, this report also u^ed a maintenance phase that served to indicate 
whether a certain level of performance vyould maintain once instruction was 
removed. ' * ^ 

Another point that has been stated earlier, is that effective teaching tech- 

\ 

niques are not always complex. T^he one used here — modeling — consisted of 
only a few elements and took only a few seconds to administer. In fact, some 
children, as indicated by the last experiment in this report, were able to learn 
new information when only, a part of the modeling technique was used. 
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In regard to teadhing procedures, I advocate that they, of course, be 
effective, but as simple as possible. There are two reasons for using only the 
mildest and briefest remediation pi^ocedure. Onei if a procedure is used that 
takes more time than necessary, teacher and pupil time are wasted. Two, 
^if a complex procedure is u.^d to effect change, an inordinate amount of time 
could be spent in weaning the pupil from the procedure. Teachers, like 
physicians, should prescribe enough'treatment to cure the problem, but no 
more; for in both cases treatment immunities may build up that require the 
use of complex solutions . 

J . ' ' ' 

I The imj^ortant messag**', however, to come from this project is that once 

a type of skill has )?een specified for ,ins^*uction, and a legitimate technique 

such as modeling is arranged, the acquisition of that skill can be sudden. In 

this project, once the teacher showed the pupils how to do the problems, they 

invariably complied. Their acquisition of the skill was not gradual over a 

period of days, but immediate, 

Prbficiency tech ni que s and arithmetic .^ With some pupils, for certain 

types uf problems, the bas^c concern is for .proficiency , not acquisition. Some 

pupils are able to corrfpu^ . certain problems, hsX they require so much time 

to arrive at the answers that they are not proficient. 

f 

In order to use computation skiljs in everyday situations, a person must 
be somewhat facile. If he is requn-ed to make change, he must do so wi'thin a 
reasonable time. If someone buys a commodity' from him worth $15 and gives 
him $?.0, he must rapidly calculate how much change he mut* return. The 
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customer would be unirapi-essed if the merchant took 10 oi 15 minutes to complete 
such a transaction . * 

In this series of studies, several int^vtlntions were scheduled in attempts 
to assist pupils to become proficient with certain arithmetic facts. In most 
instances, ABA dfesigns were used; in fever y study reliability meabures were 

obtained. ' . - - 

* • 

Initially, in order to deternjine whether the pupils were proficient or not, . 
we obtained data from public school pupils the same age as ours, as they worked 
on several types of problems. V/e then calculated the correcc rates of those 
pupils for the va-rious classes of problems. ,Next, for ail classes of problems', 

the correct rate scores were ra/„keV. We selected the 75th percentile score for 

* ft 

each class as the d<;sired rate; to be proficient, our pupils had to score at or . ' 
above that score. 

During Study 1 a, baseline period v^s initially scheduled. Throughout the 
intervention^period a verbal instruction was programed. Each/ day, prior to the 
arithmetic assignment, the pupii was instructed to "go faster." ^ 

The results indicated that the correct ra.es of all-children improved during 
this phase. Most of the pupils obtained rates that were proficient. When the 
instruction was no longer scheduled throughout the thii-d phase their correct 
rates contin-.ed to be satisfactory. 

In the next study, following a baseline phase, contingent toy models 
were arrangefi. Throughout this intervention pl.ase a 4: i ratio was scheduled; 
for each four correct r( spouses one pe nt was granted. Models were purchased 
for 50 to 75 points. All the children's correct rates 'mproved when this con- 



tingency was arranged, bi^tnotas much as when the simple instruction was 
used. Some of the pupils^ scores reached proficiency*. When the intervention 
was removed,' the correct rates of the pupils. generally maintained . 

In the nex. study three types of feedback were investigated. 7ollowing 
a baseline phase, a type of feedback was arranged. The three types of 
feedback were: a) indicate correct and incorrect problems on the pupil's 
paper, b) inform him of yesterday's and today's correct rate, and c) tell him 
the day's rate and the desired rate. ' 

The results frcui these feedback studies were very unimpressive; ^only 
small gains were noted for a fe^y children. V7hen the interventions were 
removed, some rates actually fell below baseline level, 

'The final intervention in this series of studio-, was a combination 

0 

of the two most successful profi-.iency techniques. The interventior com • 
pri. jd the instruction to "go faster-*,' and the toy model contingency. Fol- 
lowing another bcseline, this intervention was arranged. During the inter- 
vention phase, prior to responding to the pr6blems, the pupil was giveti the_ 
instruction; then., followin3 the session, he was granted points redeemable for 

irtodels on a ,4: 1 ratio . 

The results of this study were the most impressive. Ail pupils' correct 
rates improved r orfe than they had When either the instruction or the model 
j , ^ervention was used . ' In every case proficiency yates were reached . 

•f 

■ "T' the Teacher. An important i- ature of thisproject teachers should 

consider regards the distinction betv^ce^ acquisition and proiicicncy. One 



reason to develop such a discrimination is thai the goals for either are 
different. Generally, the objjctive of acquisition projects is accuracy; 
wherea?^ the objective of proficiency projects is increased speed* 

A further reason for distinguishing between the two types of per- 
formance is that, quite likely, certain instructional techniques are better 
suited for o^ aspect of performance than the other. When the concern is tc 
assist pupils to acquire certain behaviors, some of the instructional procedures 
might be modeling, various manipulative aids, drill. If the^ concern is to 
develop proficiency, certain useful techniques might be those discussed in - 
this report, telling the pupil what is expected and reinforcement contingencies 

This project again noted the positive effects of simple teaching. When 
the pupil v^ere told to "go faster," they did. In fact, the effects of simple ^ 
instructions were even more influential than contingent models. Often, when 
instructions are cle^irly and consistently stated, pupils will comply. 

It must be pointed out, however, that the best effects on math per- 
formance were noted when the two procedures were combined. Although I ^ ^ 
h.we cautioned against using more instructibn than is necessary, V could 
be that m order to obtain immediate and impressive proficiency gains, two 
established prooeduves should be combined. 

A further note from this research that should be considered by 
to::cherb is in reference to an ineffective procedure. Teachers should 
b" oa tY lookout for not only those procedures that are generally effec- 
tive, but those that are generally ineffective. Three types of feedback 
were used in this study and the performances of only a few children were 
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iiiinimally influenced, in the preceding study a type of feedback was not 
effective in an acquisition situation. 

To us, these results were surprising, for there is an abundant litera- 
ture about feedback which g^inerally acclaims its benefits. It is possibit^ 
that our pupils had poor experiences with feedback and generalized from 
that. It is also possible that the types of feedback we used would Le 
effective m other academic areas or that other types of feedback would be 
more effective in ma^h. These considerations nothwithstanding, I would 
recommend teachers carefully evaluate their feedback techniques, 

8 *^ 

Withdrawal of pos itive rein f orcemen t. ' The primary ^ ifficulty of 
the pupil in this stxxdy was not acquisition,, for she could solve rather com-^ 
plex computational prol.I-^ms. Neither was her difficulty one ot obtaining 
proficiency, Iler correct rales for most basic facts matched those ':er 
peers,, ' 

This young lady's performance was erratic. Some days, when asked to 
perform certain . ubtraction problems, she was very accurate. On other 
days, she erred on all the problems. Occasionally her respon' js to a 
row of problems would simply be a series of numbers, like 21, 22, ^3, 
She was apparently not motivated to perform consistently. 

Daily, this vounp lady was assigned three pages of arithme^l^- problems. 
Oa each p'i^c we^e 25 problems of a different class. The Class 1 (CI) problem 
wer ; like 18 - 9 = [ ] . C2 problems were of the class 24 - 6 - [ ]; 
borrowing was required, C3 problems w^)*e like 34 6 = [ ]. c^aiii bor- 
rowing?: was i-equired. For each class of problems several sheets of dif- 



ferent problems were developed. Thus, the pupil worked on jifferent 
figures from iay to day. Reliability checks, pertaining to items pre- 
viousiy mentioned, were obtained thmughOvit the study. 

The design of the study v/as a multiple bcrieline. Throu^^iiout the 
baseUne ph^&e, w^ich .n for six days, no instructicr , feedback, or rein- 
forcement was b^heduied. When "^he pupil had responded lo the problems 
on the three sheets, she submitted her papers to the teacher. No further 
in-eraction took place « Ker pei .^rniance during this perioJ whf variable. 
Her scores on two pi the three she'^^s were high one day and low the next 

Csee Figure 2) , 

t '^^ 

Figure 2 c Ijout here 

Throughout the r^econd ..r.^.tion of this projoct a withdrawal contin-* 
gcncy went into effect; for each error she made on the CI sheet, one 
mi iUte of recess ti;> e was taken away. The data from this pha.- reveal ^.d 
that hi^r scores on Cl ;vere hif;;h, but her scores on the other two sheets 
remained low. 

During the next phase ^he same v ithci. awal coiitingency was associated 
with t,he C2 problems, in additicii to the CI items, In the next condition 
the con^^'^.gcncy was arranged for all thr^o sheets. Throughout those phases 
.he results wore imprssive. .Successfully, as the contingency was arranged, 
the gi: I's performance improved. 
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During the next two conditions, the contingency was removed, lirst 
from the C2 sheet, then from CI. In the final phase the cor '^ngency was 
in elfect for gnly the sheet. As indicated in the figure, ner accuracy 
on aU lae sheets remained high, even when .he contingency v/as remov d. 

In this project, instructions were not used; for in the past she had 
been asked to "be more accurate" and "work faster/' She was not responsive 
to comments alone. Neither in this project were other, commonly used 
instructional techniques like feedback, modeling, or teaching aides, u3ed. 
She knew I^'^w to solve the problems, aiid did so when she wantid to. Her^; 
was a motivational problem. Since sht sav/ no reason for performing the 
problems, her motivational system needed to be altered. Tv- offe^-. that ^ 
changc/'she was deprivea of receSs time contingent on errors. 

That the girl v/as sensitive to the withdrawal contingency w^s 
indicated by licr response pattern in two way^ First, she reacted imrTcdiately . 
On each sheet, the day the contingency was sched^, jd, her per.orman improved 
greatly. Second, this immediate accuracy was noted on only the contingency 
sheet; wjien tPci point removal technique was arrmged for Cx, only n_.ic^*mance 
on that sheet improved, net on th-. other two. 

It was somev hat cncour' ging when hei iccuracy contiii jcd to b . high durin^ 
the final two phases. When the contingency was removed from the C xnd 
C2 sheets, her performance did not collapse; apparently b Jiething wa3 maintaii in 
her behavior be.sides Iho withdrawal contingency 

"To the Teacher." Several times I ^.vive mentioned that the s.mplest t Cii- 
niques ^^ossi^^e should be used to ^nanje beha^nor. I have also state ' t/ at 
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when artificial arrang-T.ents are used to induce favorable change, teaching 
is not finished even though the target beha^'ior improved. When . artificial 
technique is used to stimulate progress, once progress is noted, the teaching 
situation must continue until the pupi' can perf .»rm the behavior under natural 
conditions. However, this is not to sa/ that artificial circumstances should 
never be ar.-anged; for if the goal is to teach something and that skill dues 
not naturally develop, synthetic aids, sometimes in the form of reinforcement 
contingencies, must be used. 

Fur hermore, reinforcement contingencies should be the initial teaching 
technique in im :ancjs wh-re the teacher knows the pupil can perform .ne 
task but will not. If the t ,acher has every reason to believe a pupil is 
capable of performing a.ta^k (perhaps he d^^monstraterl thib ability in the 
past'), thx teacher w^ould probably be unwise to select teaching strategies 
like modeling or instructions. For if the pupj is not motivated to perf^>rm 
the task, he probably wilLaot until the motivational atmosphere is changed. 
Often tcicl.ers in instances like this shift from one non-contingent teaching 
technique to another in a Quixotic search for an eifec^^ive technique, when 
instead they should have '^hanged the motivational sys'em by arranging a con- 
tingency . 

In selecting a contingency the teacher has the choice of giving the pupil 
something contingent on a specified behavior or taking something away. Jn 
this project minutes of /ecess were taken away tor incorrect answers. 
It couid have been arranged so that additional'mirutes were given for 
correct answers. Another possibil'ty, of course, would have been to 
give soniething fur correct arswers ^nd ^?ke away for .ncorrect answers. 
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ObviousV;*, whether the event as given, taken away, or both, it should be 
something of value to the pupil. Otherwise, it would be unlikely that 
his performance would be affected by a contingency. 

Var ious typ^s of story problems , The preceding projects in this 
section dealt with computation problems. Obviously, there are other impor- 
ta'^t components of the mathematics curriculum. One of the major elements 
of a complete math program in the elementary grades is story problems, 

Most teachers agree that pupils must kno-/ how to use the computation 
skills they have acquired. Many believe that story problems provide an 
opportunity to use those skills in a realistic w y. 

Most elementary teachers also agree that it is one thing to teach 
children to develop computatioi- skills and quite another to teach problem 
solving skills, i.e., story problems, Some teachers have attributed this 
discrepancy to thj, fact t' at when pupils are reqtiirtd tc '^Ive story 
problems, they must read, and the reading le/els of math texts zre be/ond 
those of their ^ending texts. In a compariscn study that we conducted 
it was revealed that this was not necessarily the case. When matched by 
grv^Je level--readers and matL texts-son.e children actually read better 
fr:)m ce tain math texts than from their assigned readers. 

With that informauon we designed investigation for the purpose of 
identifying which elements oi story problems were most troul;)losome . Our 
first st'^p was to study the story probiem fcrmats from three cummer cial 
arithqietic texts. V^e then cc.istiucted several problems fc." a number of 
format types 
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^ Our plan was first to offer pupils probioms of a very simple t'ype, 
then to present problems that included more format variation. The oroblems 
were changed from one class to the next by cither adding one more i lement 
or changing one feature of the probl'^ms. Most of the classes of problems 
represented a specific format found in comincrcial arithmetic books. Wsing 
such a plan, advancing pupils from one clcss qt problems to the next, ve 
anticipated that we would be able to detect which elements of story prob ems 
were most troublesome. * * 

Before the pupils were given the story problems, we tested them to 
be certain they Knew the 32 words used in the first class and could compute 
the facts used in those problems* Once this wa;^ determined, we proceeded 
with the study. The first class of problems Vv'as like the following: 
"Jonn had 2 apples < Tom have him 4 apples. How many apples did Joh 
havo thvr.^ ' Ail of these problems used the same proper nouns, only thJ 
noun appijo , and were made up of throe sentences. 

Rather than describe the other classes of problems, I will note some 
of the forma; tr^odifications that were included. In one class we added 
a le-^d sentence *hat was not necessary for solving the problens: 
''John I'ked apples." In anciher class we put in a sentence that had mis- 
'oading information. If the problem :!ealt with apples, some information 
about another category, plus an irrelevant numeral, was included. 

In some ci^ss'^s a v^ide variety jf nouns were used; initirlly only 
appk s w^as u^ed. Later, the proper nouns were expanded; initially, only 
John and Torn were used In som^ problems the numerals were presented in 
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two different ways (David had four burros. He was given 2 burros) . In 
another class blanks were included; ordinarily they had not be<^n used. 

The thirteenth class was a potpourri. Problems from all the preceding 
classes were presented on the same sheets. When a student had reached 
criterion for all 13 classes he was assigned, over a period of days, 85 
problems taken verbatim from three elementary arithmetic books . These 
problems were mixed both in terms of format and process; one problem that 
conUined four sentences and required addition was followed by another - 
problem that required subtraction and included irrelevant information. 

Each day the pupils were given three sheets of problems from a class: 
one add. one subtract, and one; combination add-subtract. There were 
fi\^'e problems on each page." Several sheets were made for each format- 
add, subtract, add-subtract . The pupils responded to different problems 
from day to day. When these problems were presented to the pupils, they 
initially received no feedback. This bps^eline ran for six days. If at 

the end of that time their scores were perfect for three consecutive days 

J I 

on all three sheets, they were advanced to the nexi class of problems . 
If however, their last three scores were not 100°6, a teaching technique 
was arranged. Now, following the completion of an assignrgent, the pupil 
was required to read aloud each incorrectly solved problem. Two other 
teaching techniques were devised and successively used if the first 
technique proved ineffective. 

This strategy of moving from one class to another only when three 
successive 100% d.-ys were noted on all sheets was adhered to throughout 
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the study. Reliability checks were obtained as the students performed 
each class of problems. 

The results indicated that our children had little difficulty in 
advancing through the 13 classes. In lespect to correct rate and 
accuracy, the scores were lowest for most of the pupils when they began 
the class that included the misleading information. Furthermore, most 
pupils had difficulty with problems which included an irrelevant lead 
sentence, a blank, and numerals presented in two ways. When the pupils 
were required to respond to the mixture of problems on class 13, and t}»e 
85 problems from the m^ath texts, they committed very few errors. 

Throughout this study about 40% of the errors were operational (add 
rather than subtract) and 40% computational (4 + 3 = 8). More errors 
were made on the combination sheets than on those where only addition 
or subtraction y/ere required . 

When the first, instructional technique was required, it was generally 
effective. There were few instances when thti other two techniques were 
used . / 

In order to respond with consistent accuracy to the story problems 
in commercial texts, the pupil must dQvelop several skills. Certainly 
he must have the requisitv.* computation and word"*^calIing behaviors. Beyond 
those skills he must be prepared to writfj his answer foUowJtng or sometimes 
within the problem, to discriminate betwec^n necessary and irrelevant 
data, to classify and group nouns, and finally to make dozens of discrunl- 
nations be.wern various cues and foils from one problem to the next. 
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Apparently our project was to soiffe extent successful. After the pupils 
had responded correctly to our 13 classes of contrived problems, they were 
quite able to solve the multi-differential problems from the^commercial 

I 

texts. . ' * y 

"To the Tsiiacher . " One of the important features of this study for 
teachers to consider is the neces;5ity to design materials. The story 
problems in all the commercial books we .investigated varied 'considerably ^ 
from one to another. Furthermore, most books coritained few story problems 
of any type. If a teacher desired-td' teach story problems she should 
first identify the types of problems, then she must gjenerate several problems 
of each type. ^ 

This study represented one strategy tov teaching story problems, that 1 
of assisting pupils^o develop competencies v/ith first one specific 
type problem, theh another. When pupils were able to compute problems 
of one type at a time, they were assigned problems of all classes. This 
instructional strategy could apply to subjects other than story problems, 
that is, teaching one class of problems at a time, then teaching pupils 
to solve problems of many types together. In spelling, for example,^ 
words that bontained one phonic element could be taught, then other types. 
Finally, words of many classes could be simultaneously presented. 

By contrast, another teaching strategy would be to present problems 
or items of several classes at the same time, then, if the pupil could 
not discriminate between typ/^es, certain types could be removed from the 
program until he could discriminate from among those left. In this study, 
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the pupils could have initially btien offered story problems from 12 dif- 
ferent classes. If they could not solve problems of certain types — if 
certain types were confusing^ --those problems could be pulled out of the 
program. Problems of other classes could also be remi ^^ed until a pupil's 
performance was satisfactory. Oace that point was reached, certain problem 
types could be gradually put back' into the program. An instructional 
technique could then be focused on the newly introduced problems. 

Another feature of this study that deserves some consideration is 
the' practice of analyzing errors. In this project errors were categorized 
as operational or computational. Had some students committed several 
ei-rors of one type, specific remediation for that form of error would 
have been arranged. Regardless of the program — reading, penmanship, 
computation, story problem5>--the teacher must do more than count correct 
and incorrect responses. The child's style of responding must be analyzed. 
Often ii the child'.s pattern of responding is studied, clues for sub- 
sequient remediation will be provided. 

Spelling Research 

A free time con ti ngency with fourth ^graders > One of the few 
studies reported in this chapter that were not conducted in the R.csearcli 
Classroom was car; ied out in a regular fourth grade. Perhaps the most 
significant feature of tins investigation was the demo^istration that 
leisure time could serve as an effective remforcer for most of the members 
of a class. In order to arrange leisure time as a contingent reinforcer 
the classroom was slightly modified. 



The study took place in a class of 32 pupils- The project was con- 
ducted entirely by the classroom teacher, who administered the spelling 
program, calculated and graphed the pupils' scores, and managed the con- 
tingency system. 

This study used a simple AB des^^n. During the baseline phase of the 
study spelling was administered in a very traditional manner. On Monday 
the new words were introduced and the children read a siory containing 
those words. On Wednesday a trial test was given. On Thursday they 
completed some workbook exercises pertaining to the words, and wrote 
each word several times. On Friday the final test was given. Each 
pupil's Friday score was graphed as a correct percentage score. 

During the next phase the pupils were presented the ne iict of words 

and giv(^n the same type of spelling assi^'jnments as before. The pupils were 

\ 

\ - 

now simply required to hand in tjbjeir work. No specific time was scheduled 
for the completion of the:;e activities as there had been during the first 
phase.. The major difference between thi^ condition and the former was, 
however, that spelling tests were given four days a week, rather than only 
one. 

During this phase the pupils were through with spelling for tl^ week 
when they received a 100% score. If on Tuesday, the day of the first t\st. 
a pupil scored 100% and he had handed in the assignments, he vas fre*^ 
during the time of the subsequent spelling te-,ts to en'^ag in a number 
of leisure time pursuits. He could read a comic book, work on a puzzle, 
draw pictures. The pupils continued taking the test until results were 
perfect,^ or through Friday. 



Throughout this phase tlie teacher recordud thvT pupil's score as 100% 
if he rejturne,. a pertect paper on Tu^^day, Wednesday, Thursday, cr Friday; 
otherwise, if ihe pup'i never a^ ueved 100%, his Friday scor-c was r^^corded.* 
Furtnermore, the teacher records i on each pupil's graph a number which 
corresponded to the day the scovc was obtained: 1 = Tuesday, £ = Wednesday 

As a result of being able to earn free time or to escape ^from ^^peUing, 
th^ performances of most children impro cu. Twice as many iOL © papers 
were recorded in the second condition than during the first. V^ny children 
obtained 1^^% scs>res 1 1 the second phase that h^-d never before done so . 

' Ttfc^the Teacher." This projec, bey^ nd the fact th. c p system to 
arrange free time in the classroom wab devised, suggests a strategy for 
assisting teac^^ers to gauior data. Pernaps when teachers a- '"cqu.'^sted 
to obtain data and plot graphically the aca iomic performances of p\ipils, 
<?pelling is the best place to begin. Two reasons might sup^jort such a 
^t'^tcment. In the first pi^ce, spelling is probably instructed more 
sy«itemcicically and tested more regiflarly than o^her acade..iic skills. 
I'hf proce^^ut^s for instructing spellii ^ are et^:.entia]iy the same from 
week to week. Furtaermor'^, spelLng . jrformance is generally assessed at 
leasL once each week. The second reason for using spellijng as thc^ spring- 
board f ' bt-^ining records of academic performance ihtxi mobt teachers 
alreaay record pupil performance in spelling. Many teachers indicate in 
th^jr record books the weekly percentage «•* res of the pupils. It is 
a Simple matter to convert th '"-e n >tations into j)er( entagc points m a 
graph., 



Although this pi-ojec^. dealt with spelling, arrang.ments similar to 
those used here could be incorporated in other subjects. The only-rt— 
quiremenls would be: a) arrange a- definite period eaoh day to offi • the 
subject: ?) est.;blish a crite;rion for satisfactory performance; and c) 
designatt. some jlace fcx" pupils to spend their le^^ are time, and, of 
cou'- 3e, provide enough events that are reinforcing. 

.ihib strategy, for example, could be used in arithmetic comp -t^^tion. - 
The pupils could be given : set of problems to master each weolc. A 
specific period e^-^^h day could be sC eduled to work on those facts. On 
several days of the v;eek tests could be Civen, and when the students 
scored perfectly, they could be relieved from math computation for the 
week, this project the pupils "took free time at tLeir desks; for them 
this was a satisfactory arrangement. Pupus of other ages or types might 
be more reinfi ced by leisure time if a special room was set as:- 
for gimes and free play. Several studies have been condac'od where special 
rooms have beer, established to be used exclusively for free time. 

teachers could certainly improve upon this project in term? of incU 
viduah^ation. Throu^^hout this project all pupils were assigned che same 
spelling words. Altiiough all students improved, sor.ie students had to work 
>i.>*der t'^.an others. A teacher could use the same free time cc itingency 
used here, but individuaUze the spellino words, arithmetic problems, or 
other academic a?-ignment. 

b • d reversals. A problem with many learning disabled children, 
at least insofar as their teachers are concerned i? the reversal lemma . 
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Teach-g^'s frequently express their concern about children who transpo:ie 
1 

letters. The classic example used when discussing reversals is the 
b ; d trarlspositio*^ . 

^?r<^al$ can be noted in two forms: writing anc' r-^ eiking. In the 
former a pupil could, when asked to write the word dog, revei - the d 
and instead v^rite bo^. At that point the pupil has a spelling problem. 
The project described here is within that context. 

The subject of th^s experiment was a lO-yej- -old boy. A teacher 
in our class had observe, thc.t on occa ^lon, when he as asked to write 
certaia words he reversed some letters ♦ Often he reversed the letters 
b anc' J . 

An ABA design was adopted in this study. During a baseline period 
tiie pupil was a^^d to : ell several three-letter words that ended or 
blgan with eith.jr bo: d. The data during this phase pointed out the 
ire^.ucncy .d extent of the difficulty. He rarely substituted d for 
b. but often substituted b for d. Further, ' reversed d more in initial 
than )n final posuiun 

The intervention was simple 3**^J effective, Lwery day during the 
:ntfrve-^tion phase the teacher showed the pupil the word dam. He was the 

ked to read th*. v^ord, then name the first letter, then write the word. 
Next, lie wao t^hown the word bam and asked to na.ne the first letter. 
v.as a^:uin asked lo name liie fi/st letter of the word dam, then instructed 
to write the \ ' d. After this teaching period, which lasted about 
45 twcorih, he was asked to spell the same words used throu^^.hout the 
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baseline . 

The effects of thiG procedui e were noted imn.ediately . After five ayb 
his accuracy for ail words was 100%. Throughout the next ^hase no instruction 
was provided. He continued to discriminate correct}^' between b and d. 

The next concern was to determine the 'extent to which tnis newly 
acquired jd discrimination generalized. Generalization was assessed 
from two more word lists. The words on the first generalisation list were 
short words whi.h coulained a b or d in final or initial position. Although 
these w.-re diffex-ent words than were used on the first list, the pupil spelled 
them all correctly. The second generalization list was composed of two-syllable ^ 
words that included a b or d m final, medial, or initial position. His ability 
to discriminate again generalized; he spelled all the words accurately. 

The teacher was then cur" , 5 as to whether this generalization would 
be noted in a context other than spelling. Although she hoped such a transfer 
would occur, she knew it was possible for the child to develop a skill in 
one situation and be unable to extend the skill to other settings. In order 
to discover v/hether the discrimi \tion skill had transferred to another situation, 
the teacher checked throug'h several of his penmanship papers for a period 
of time following 'he b - d study . She found very few instances where one 
letter was substituted lor the other . 

"To the Teacher This pi eject points out the advantage of pinpointing 
several related behaviors and measur .n^, each over a period of several days. 
By so doing, the teacher discovered the student's reversal difficulty was 
not pervasive. He generally substituted *b for d. Thus, a precise and extended 
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diagnosis, like the baseline of ihib study, is called for to determine the extent 
- '>d frequency of tho problem. It is certainly much easier to design a .remedial 
technique for the overuse of b's, than for more global reversal problems-. 

those pupils said to have reversal difficulties, it is possible that more 
of them occasionally transpose certain symbols than invariably tianspose 
all reversible symbols. 

A second point about this study that some might consider significant 
IS the extent to which generalization was monitored. By measuring the pupil's 
ability to discriminate with words and in other situations, the teacher knew 
that learning had transferred; she knew thai the remediation was not situation- 
specific. His dyslexic ailment was apparei>tly cured. It must be emphasized, 
however, that although generalization occurred, teaching was directed toward . 
the primary behavior oi concern. 

A third point of possible interest is another example of simple, j 3t 
effective, teaching. When tho little dam procedure was scheduled (which 
was prompted by the student's behavior) his performance quickly and signifi- 
cantly improved. 

Commnnication Research 

^ 

Penmanship: Correct next day . This project was based on a penmanship 
study conducted by Hopkins and his collcagaes (1?71) . Their subjects were 
first and second graders whose mode of vriting was eitiier manuscript or 
cursive. In their investigation the total penmanship period was initially 
50 minutes, including work and froe time. During certain phases of that 
study the pupils couid go to a playroom when they had finished their 



ERIC 



\ riting assignee .ts. In that investigation, the amount of time scheduled 
for the totu. penmanship p^:iriod was systei. tically reduced; the amount or 
time* available :or play vvab accordingly lessened. The data indicatec' that 
as the time for the total penmanship • ericd w ".s shone ^d, the race and 
accuracy of penmanship improved. 

The ideas of allocating a specific amount of time tor a period, which 
iiicluded work and free time, and allowing pui ils free time when they 
finished their assignments, appealed to us. Further, .ve were curious 
about two oth^r aspects ( ' the Hopkins investigation. In the study, although 
there was not a systematic effort to deal .viih errors, the pnpii . incorrect 
rates were generally low. It had been our experience in past penmanship 
studies that unless some attention was directed to errors, rather high error 
rates could be expected. Tho second fea^^.re that intrigued us was that 
their students' manuscript and cursive writing rates were so low. Compared 
with writing rate data we had obtained from normal first ana second graders, 
the pupils in their study were^not nearly as proficient. 

In an attempt to replicate certain features of the Hopkins research 
and to provide data regarding our qt:-. ries about that study, we designed 
a similar penmanship .study. In order to investigate whether systematically 
attending to errors would inflL..nce quality ^f performance, several conditions 
were scheduled where an error contingency was alternately arranged, then 
withdrawn. In respon^je io the aspect of proficiency, we obtained writing 
rate data from normal ch;idron and used these as desired rafos for our pupiL^ 

Our study began by requiring the pupils to alternate writing styles 
for a few days. One day they copied a 500-symbol ctory in manuscript. 
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the next in cursive. The purpo-e was to ceterm'ne which r-ode would be 
used foi* initial instruction 

^ Cnce we had made this deiermination, the inveb .'.gcxHcn began Each 
day the pupil was given a sheet on which a 500-symbol extract from a reader 
of each child's reading level. A symbcl included a letter, punct .ation .nark, 
or space. 

An ABA design was ^.sed throughout the stuu> Duriuf ih^' first phase 
the pupil simply brcaght his completed paper t tb ^ teacher, who checked 
to see if everything was copied. The Dupil was then 5ree to go to ^ leisui^e 
time area. 

The total penmanship period lasted 30 minutes. If the pupil fin^ hed 
his assignment in 15 minutes, he was free to play for 15 minutes. FpHowing 
the 30-minute period the pupils participated in a social studies activity. 

Each aay t.;o data plots were entered , cor.-ect and incorrect symbols 
per minute- Err ^rs comprised the following categories: case, punctuation,, 
spelling and penmanship, .Reliability ir-casures v.ere obtained throughout 
the study in regard to accuracy of checking responses, general procedures, 
and timiiig. 

Throughout the baseline period the teacher did not attend to errors. 
During the \ ^xt condition, however, a quabty control contingency was put 
into eiiect. Now the pupil had ti) correct his errors frdm the previous day. 
If a pupil left out some letters or illegibly forme some letters on Monday, 
he was required, on Tuesday, to complc ^ tfic regular Tuesday assignment, 
them correct ah " his 'vlonday mistakes. 
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This condition, s in effect ^or about 20 days. During the next pha-e 
the o/iality control Wiis lifted; the arrangements vere Identical to thoce ^^f 
the baseline. 

For the majority of Mie boys this : :>rrect-the-next-day contingency 
was very eff,. :tive; their incorrect rates dropped considerably. For a few 
pupils, however, this technique did not result in reduced errors. Of those 
children, ^^^.r e^-ror r^tes fcr two were reduced when the / were required 
to correct their mistakes twice rather than once che next. day . For a third 
boy, whus>^ errors were not u^idally attenuated, the 3ame procedure was'^ 
used, but Le was required to correct his ifiistakes the same d^y . Tins alteratio 
resulted in success, 

s 

Included is Figure 3 that illustrates the performance pattern of one 

t\ 

of the b<.';ci. The correct-the-next-day contingency was effective for him. 

* 9 

Figure 3 About Here 

During ihe pre-ba^.eiine period x: was decided to commence his training 
with manuscript writing . bu^-ing the baseline phc^se his correct and 
incorrect rates were fairly close together, indicating very low accuracy 
In fact, his errors were increasing from day to day. The data in the next 
phase were quite different. In.mediatcly. vhen the error correction rule 
was imposed, his correct rates incroase( a Lit and his incorrect rates began 
to plummet. \^hen the error conHngcncy was withdrawn throughout the next 
phase, the effects were almost .is radical and immediate: his incorrect 
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rates suddenly increased. In the next phase, when tho error rule was reinstat 
his errors once more dropped ccnsiderably . 

In regard {d errors, our pr':)ect did not totally agree witii the Hopkins 
data, '^he errors of om pupils were not lessened until a continc^ncy was 
schedul-Zid. Luch an apparent diflerenCe m the two studies could have been 
due to distinctive instructional styles of the teachers. Perhaps Hopkins' 
teachor had, in the past, attended, more'to errors than our teacher. Or, - 
possibly the' manner in v. hich errors were checked was more stringent in 
■one situation thin in the athcr. 

As to writing proficiency, we had, prior to the study, obtained writing 
sample^ from dozens o£ children in ^ ^ manuscript ana cur six e f,,.*-m. We 
ranked those data and selected as uesi/ed rates the 75th percentile correct 
rate score and the 25th percentile mcoi rect rate score. For manuscript^ - 
these rates were 22 corr<;ict words.per minute and ..15 errors per minute. 
In the figure included herb it can be noted that the pupil* s correct rates 
always exceeded the criterion, but his incorrect rates were av .h*too high. 

In the Hopkins research the rate the best manuscript writer at any ^ 

poinc )p the study was far less than the desired rate we had chosen. This 

discr-jp. ncv could be accounted for in part by the fact that th'^iy counted 

only letters, \ heroas we counts d symbols (letters, spaces, and punctuation). 

or 

A more p^'^bab'''' reason for this discrepancy, however, was that the pupils 
in the lie yKins study copied from halkboard, ;/hiIe ours copied from a 
paper at theiV deslc? . 



"To the Teacher." There are several points from thife study that havc^ 
beon emphasized earlier First, J e, cortingenv' used here was aKiout the * 
same ^s Miat arranged in one of the spelling studies: when work was satisfact- 

orily completed, free^time was a /ailable. In this S-udy, as in others errors 

'" '^ . t ~ ' ■ 

were categor .eJ so that each pupil's mii takes could be analyzed by ' /pe. 

Although in this' study the same type of intervention was used with 

all pupils, the^ exact way the intervention was used depended on the behavior 

of each .child During the period when the inwrve^;tion was scheduled, ^ 

the pupils had tp re-do alt their mistakes; if a pupii had difficulty with a^ 

particular letter or letter combination, he had to practice it. 

This brin :s out §j«jth^r feature of individualized teaching that has 

• V- • ^ ' ' ' 

at least been attended to m this v,hapter, Is, individi^aliaed instructional 
procedures. Althmagh many people at leas: |^ay lip service to individualized 



liet diat to mein that indivit 



teaching, they gent^rally interpivet ciiat to mean that individuals are beirig 
tau-ht skills at various levels. If instXuction is to be truly individualized, 
it would require that every component of the educational situation be individua 
ized. That would certainly include the program and the teaching procedures. 

A feature from this study referred to earl: -^r in an arithmetic report 
was the matter of desired rates Prior -to runn^ig our penmanship study 
we gathered some penmanship data from regular school children. These 
data served as desired rates. The primary reason for obtaining desi>-od 
rates from other pupils is for refertjhcc purposes; we must have some gauge 
as to the extent pupils should be taught. Certainly, in situations where 
the goal is to normalize childr^'n or to send them from a remedial setting 
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to a regular situation when their prcJ li»ms ar solved, desired rates should 
be gathered. For if the pupils a/e ex}. ecco|l to survive in a class where 
Jie performance levels are cu^renliy higher than theirs, they must be iz-*5tructed 
to the pel" ' where they are equally proficient^^"''^'^ 

A hnal point to consider from this study deals with calibration. It 
will be recalled that in our study we counti c symbols wrivtcn, whereas m 
the Hopkins study words written were co-^ iced. In many subject matter 
areas the teacher can identify the item "o.bo measured along r scale from 
very broad. to very specific. For '^^-lample, in reading the teacher could 
measure the following: books, caapters, pages, paragraphs, lines, words, 
or phonemes read. Cbvi:>usly, it would be easier to raeasurt^ books read 
than phoiemes proncainced. The decision, however, as to the amount of 
precision required should not be based totally on ease. The te? :her should 
generally measure that which is being taught. If instruction is focused on 
specific phonemes, they should be measured, n'^t lir s read. Correspondingly, 
the teacher should probably not measu^ more specifically than need te . 

Cursive writinf^. Effects of sel ected ch ecking . Second only to readirg. 
penmanship has generat.,d more rcscc.rch, discussion; and controversy than 
any other academic subject. P'jrhaps the b^'ggesl controversy regarding 
penmanship instruction fucus'js on the manuscript-^cursive issue. Most schools 
routinely start all children on maiiuscript v/ritijig, then shift to cursive. 
Some schools make this Ghift at the end of the second grade, ^al.ers as late 
as the end of the third grade. Convincing research to support the notion 
thr.t cursive writing is enhanced by manuscriot v^riting, much less that 



children should print until a certain grade, is to my knowledge, non-existent. 

Another issue relating to the teaching of writing pertains to the sequencing 
of instruction. Some experts state that instruction phould be based on letter 
families; words that have common characteristics should be introduced and 

taught together. Others claim there are certain letters that arp inherently 

y 

difficult for pupils to form and specific instruction should, therefore, be 
focused on those letters. 

This penmanshio study stemmed from thos« two issues. Ir respect 
to the manuscript-cursive argument, we simply started all our pupils at 
the begih.iing of the y on a cursive program, rogai^dless of their past 
penmanship experiences. As to the beliefs that instruc ,ic shouM center 
on certain families or specif icletters, we individualized the instruction. 
Attention was directed to the specific letters each pupil had difficulty with. 
Another interest we had in conducting this project was to study transfer 
of training; to determine whether, if teaching is focused on certain letters, 
other non-taught letters will improve. 

A final objective we had was to establish a cursive wru ng piugram 
that was quick and effective. In the previous year (the preceding project) 
we were able to change the writing rates, hence the legibility of the pupils, 
but we believed that program required too much time. 

Each day, in this project, the pupils were required to perforiP several 
tasks. Two worksheets (lower and upper case) v/ere used to obtain the 
pupils' responses. On one worksheet they copied, using manuscript letters, 
, from a list of lower case cursive letters. Next, they spoke the letters, then 
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wrote the alphabet in order, using lower case cursive letters. On the same 
worksheet they wrote 16 lower case cursive words. The other worksb?et 
was similar. The ^^ifferences were that the two letter writing tasks on the 
second sheet were upper case, and the pupil did not write the 16 words. 

Thw reason the pupils were required to write lower and upper case 
manuscript letters and to speak the names of the letters, w^, > that many writing 
experts cons Jer these prerequisite skills ''or cursive v iting. Although 
d:ta regarding these skillet were kept throughout the project -ntei^vent'ons 
were neve>- Xocuscd on those skills. We were, i^owever, intereste . in ' Mckward" 
generali*:atio By measuring compoi.cnts of manuscript and cursive ting, 
and by focusing the inter ventioi.s on cursive writing, we felt would ohtam 
data regard inf^ transfer effects. 

A multiple baseLne design vas uc^ed. During the baseline period ^ 
no teaching, feedback, or reinforcement was scheduled for any of .ne writing 
Lehaviors. At the end of this phase each pupil's lower case cursive errors 
were analyzed. The five letters that wer^ most ofien illegible in the baseline 

f 

were selected as target letters. Throughout the -ntervei-aon ..eriod if a 
pupil incorrectly formed any of those five letters he had to complete a workf^heel 
devoted to each letter. If if-ttcrs other than the five v, er^ incorrectly formed, 
he was not required to complete the exercise. The pupil was not told which 
five were selected. 

Wiien a Letter Vv^as perfectly formed for u.reo consecutive day^s, it 
was dropped from the program. When oni of the five target letters wa.s pa.sscd, 
a new one was selected. This procedure continued until all letters were 
^ passed. A second observer perit^dically chocked the scoring of the papers. 

ERIC • 
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The san»^^ mtervcntioi, once proficiency had been obtained for lower 
case cursive letters, was iucccssfully applied to lower case ^ursive wo-ds, 
then upper case cursive letters. 

After the baseline period it took pupils an average oj* 12 days to reach 
proficiency in luwer ca c cursive letters. Most of the students reached criterion 
on lower case wor .s and upper case cursive letters in about the smne lehgth 
of '*rne. 

The results from this study indicated chat irre^pecti'^e of the pupil's 
penmanship backgrounds, they could be taught to be competent cursi^'c 
v/riters. As to the opinions of others about initially teaching certain difficult 
words ?r faitiilies, those beliefs ire perhaps unfounded. At least in this 
study when instruction was focused on words ti ^t were parti^Cularly troublesome 
for students, the results were positive. As to there being particular letters 

that are difxic ilt for all childi^^en, we found that, tp' the contrary, each pupil's 

/ 

hard and easy words were unique. 

In regard to transfer of training, several instances were noted. As 
some children v/ere taught to write certain letters, those letters and other 
non-taught letters improved. In some instances the*s5s)riting of lower case 
words and upper case cursive letters improved when teaching was keyed 
on lower case letters. Finally, in some instances transfer across type of 
writing was indicated. As some pupils were taught to write cursively, their 
manuscript writing improved. 

As to our final objective, to design a cursive writing program that 
was quick and effective, evidence to support the latter characteristic vvr.s 
offered. To substantiate the former qualification, only five hours of instruction 



was generally reqiared for a p ipil to complete program. 

,^"To the Teacher." The teaching; proci^O,ure in this study hke the 
technique in the preceding study, was individualized. The students practiced 
on items that were troublesome for them, no cihers. In this study they rehearscid 
letters, whereas i;i the preceding study they practiced words. 

Another feature of ihe interventioii — its intermittency — should be pointed 
out. During the in.v^rvention phase in this study, the pupil had to practice 
on only five let: rs which were selected by the teacher.' ^ the pupil missed 
one of those five letters he had to write that letter several times; if he erred 
on other le*xers Ke did not have to practice 'them . The pupils' penmanship 
throughout tb'-^ project ^ generally good, they did not become sloppy 
, n non-selected letters. Apparently this was due to the fact thoy did not 
know which letter, if improperly formed, would result m extra pre: ticc. 

Intermittent checking could be done in another v.?ay . For example, 

c 

if a teacher, for some reason, does not have time to ciieck all the pupils 
papers each day> she couid check all of them some days or some of them all 
days. If the teacher^s prim^ary aim Is to maintain proficiency, such intermittent 
evaluations could be effective and economical . 

Learn ing to type . Many teachers devote large blocks of time daily 
to the instruction of penmanship, Some, as a result, train dozens of fastidious 
writers. It has been my experience, however, and this is shared by others, 
that it v.'ould require inordinate amounts of instructional time before some 
children would become proficient v/riter.s. That is, able to write legibly 
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at reasonably higfi rates. 

Few would debate the fact that indiv uuals ar^e requ red, on occasion, 
to be able to write with a pen or pencil. Fveryone^uses this mediunj to write 
lists or reminders for themselves and others, to sign checks, to hii qut 
applications. However, taping is a superior communicative Si-bs;. i.ute fo. 
most forms of writing except for the situations that require a personalised 
note or signature, 

When rate is considered, typing is at least three times fast^ r than 
hand scribbling. My writing rates for a 15-30 minute period avt. ai,e ab^ut 
20 words' per minute.^ My typing rates o^ the sar.ic pe* ^odare about 60 
words per minute. As to legibility, of course, everything favors the typist. 
If an a is struck on the keyboard, it always comes out the same and always 
looks like a . When I write a u sometimes looks like a, at other times o , on 
occasion u, and on a bad day, ^ho knows. ' 

Perhaps one reason that so many individuals find writing--ietters, j 
stories, random thoughts--so painful and others are so inept is that their 
only mode of textual creation is pencil pushing. Writing is particularly punisi 
ing for the person whose characters are illegible and whose rate is slow. 

TeachiTig a person to type is not like teaching someome to' fly a 747 
or captain an ocean liner Typewriters are readily available. With some 
slight rearrangeme it of priorities, every family can own a typewriter; they , 
are certainly less expensive than cars, TV sots^ and stereu equipment. 

7ith our pupils we began with line l\ Lesson 1, of the book, You 
hecAi to Type « Auer considering many books, we decided this one was the 



bc-i fur uur pupils. For the must part, we simply pi^oceeded through the 
hook» skipping only a lew of the lessons. 

fach day the students were assigned six lines. The book specified 
correct and mcorreci rates for each line. In order to pass a line these rates 
!».;ti to be Hict. When a line was passed it was checked off ard a new one added. 

Th'" data we kept throughout the year were: a) correct and Incorrect 
V ords pi^r minute (a "word," according to the book, was five consecutive 
.sp:'iCL'5); b) cumulative lines passed; and c) average number of characters 
per line. / We believed these three bits of data represented a fair indi^ 
cation of typing proficiency. 

Somo of the interventions we used throughout the year were the fol- 
lowing, a) to monitor tine proportion of time the pupil looked at his book; b) 
to tell thi^ students what their r^tes should be to pass certain lines; c) to tell 
tht:ni how many lines they passed the previous day; d) to require thorn to 
P iccicc troublv^some lines; e) lo require that they practice certain tvvO-lc ^er 
combinations, and f) to praise them for looking at the book. 

The results, after three quarters of instruction , Were very encouraging. 
Of trie seven boys, the average had complete \5 lessons', I'he average 
c jTiOzt and m^orrrct rates at the «jnd of the year were 13 and 3.5. Ail V^ut 
twu i.oy < had learned all the letter characters, upper and lower case. The 
:vt:>vig^.' total instructional time was 10 liours. 

hi conjunction with this typing project, we obtained data each day 
r^uarvl.ny the pupils' writing and typing r..tes. Fach day they were required 
to respond, by writing and typing, to three stimuli, for one minute each, 
rhvy wcr.^ expected to copy a sentence printed on a card, describe a picture. 
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and copy a dictated sentence. The purposes of these comparisorivS was to 
determine whether typing ratL.»s, over a period of time, would j^urpass writing 
rates. 

Th>-oughout the fh'st qua^^ .er these rates, for all three stimuli, were 
highly discrepant. Without exception, all the pupils' writing rates were 
higher than their typing rates. Then during the second quarter the writing 
rates began to peak and the typing speeds climbed. Final ly^ toward the end 
of the third quarter the typing rates for some boys equaled and a few sur- 
passed their writing rates 

Learning to type is, for most young children, a reinforcing activity, 
particularly when they type on an IBM Selectric, as our youngsters did. 
At no time throughout the year did we have to coax them to perform. Elaborate 
reinforcement contingencies were never required to motivate the childr^^n to 
type. 

''To the Teacher." One important point brought out by this project 
i.s that teachers should regularly and seriously review what children are 
being taught. I have referred to our research as being concerned with basic 
skills, hov^ever, that which is basic could and does change from time to time. 
I feel that currently, typing should be considered a basic skill; for it is a 
most efficient means of com.munication. But whether others agree with my 
cur ricular priorities is secondary to the point made earlier, that teachers 
should regularly scrutinize their curricular offerings. They should evaluate 
what is taught children in light o'f^the skilU required to survive in today's 
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world and in the world of tomorrow. Teachers must be careful not to teach 
outdated and irrelevant skills. 

Another point to consider from this project i^eiatcd to teaching commit- 
ment. If typing is chosen as a skill that children should develop in the 
elementary schools, time should be allocated for the development of that 
skill over a period of two, three, perhaps four years. To become a pro- 
ficient typist a student must receive a certain amount of instruction each 
week over a long period of time; proficiency is r.ot developed in a few days. 

Unless teachers and curriculum planners allow for enough time over 
an extended period to develop certain complex behaviors like typing, many 
skills will be underdeveloped. In such instances, when pupils do not be- 
come r -^oficient, perhaps instruction on those skills should never have begun 
in the first place. Unless minimal proficiency is reached, in regard to some 
behaviors, the behavior is not useable. Therefore, teachers, prior to in- 
structing certain skills should certain they have set aside enough time 
to fulfill their instructional commitments. 

A final point to be considered from this project was that, like others, 
several measures were obtained each day. As mentioned earlier, when the 
goal is to teach rather complex behaviors, it is sometimes necessary to 
measure multiple behaviors. 

Crcativo writinc; , In conceptualising this research, the word "crcdtiv 
was UL-ed in a mobt liberal manner. To us, creative writing was any writuu^ 
of an iJidividual that was for him unique. We were not tryinf; to develr.p 



writers who expressed strange, bizarro, or fantastic thoughts. Rather, our 
goah in this research 5ind other sunilar attempts, was to encourage youngsters 
to expresb themselves xn a way that is comprehensible to themselves and to 
othijrs . 

A kiriher lung-grange objective of our writing efforts has been to con- 
ceive of writing as an ideational mediator as well as a communicative device. 
It has been my experience tliat often, when a person writes about something, 
particularly when he describes what he has done and why, his thinking abou^ 
that actjvity is thereby influ-^nced. Often one lin^s, v/itii the effort of puttin.^ 
his thoughtr ^nto words, that the logic of 'his argument is less defensible 
than it had at iirst seemed. When a person writes he is forced to us^i words 
that precisely convey his meaning, to arrange sentences so that his hno 
of thought sequentially unfolds, to give empnasis lo tl e more important por- 
tions of his argument. Vve have conceived of writing as more than a method 
for commvmication ♦ 

An initial problem in conducting creative v/ritmg rcseaich is io decide 
which elements of the process should be measured. In a recent study 
dealing with composition (Brigham, Graubard, and Stan:>, 1972), the auth-j>rs 
measured the roilowing element.-: number of words, number uf d)ffcrent 
words, cind numV;er of new words. A panel of judges also evaluated the 
context of the stones on a f:vc-pcint scale. 

hi making our sclecti.>a of components tv measure, we wanted to measure 
enouph ^^emcnts so lliat botli the content and the mccl^anics of writing v/ould 



-75- 

be described. At the same time, we did not want to be over\yhelm ^d with 

data, to the point that they would be unmanageable. We, therefore, selected 

six element^ that were measured daily. Our primary measure was word 
If 

frequency. Although such a measure reveals nothing about the quality of 
.the writing, it does provide a quantitative index. We also measured the 
frequency with which punctuation and capitalization were used correctly ^ 
and incorrectly. These were the basic measures of n\echanics. In addition, 
vve kept djLta on the average length of sentences and the number of different 
words used each session. These latter two measured furnished, to some 
extent, an index of complexity if not content. The final meausre was a 
creative writing scale developed by Wmnifred Taylor (1965) . 

Daily, the pupils wrote for 10 minutes. Three different settings were 
used. On two days the stimulus was T-to^'^j starters. A portion of a story 
was read to the pupils and they supplied the ending, Twicf^ a week, story 
titles were presented. On one day, generally Friday, the youngsters were 
free to write about a t ;,xc of their rhoice. 

Ordinarily, it is not advisable m a d.:.ily measurement project to change 
the setting so often. In this case we f*^'^ justified in doing so; for when we 
kept the setang more consistent ir. p -eviouj ^vritmg studies, our pu;^il3 
became very bored; their writing \va£> anything- but creative . In another 
effort to sustain interest throughout the project, ^'-^e boys were allowe^ 
read their stories to their classmates after the period. Xlost of the time they 
took advantage of this option. 



tap* 



ERLC 



% 



-76- 

An AB design was used in this study. Throughout the baseline no 
teaching, feedback, or rcmforcemenc wa.«-i scheduled. During the next phase 
two types of feedback were provided. For one g>-oup the feedback centered 
on moclianics, for the other, feedback pertained to content. For each group 
six statements were provided the pupils after the t^-acher had scored their 
papers. Three of the statements were punitive and Kirej Vvere negative. Wit! 
tiie mechanics group, the teacher pointed out to the pupils three places 
where they correctly used punctuation or capitalization anJ called to their 
attention three places that could be improved. With the content group three 
positive and three negative sta^eme.its were offered relating to style, syntax, 
and description . 

Follov/ing this, condition 0? partial feedback, a "total" feedback phase 
was instituted. At this time the pupils v/ere given feedback on several deatih 
pertaining to either content or mechanics. 

Periodic reliability measures were obtained throughout the various 
phases of this project. These nicasures wore in regard to the scoring of 
the' several writing behaviors, timing > and general procedures. 

Following are some general reiiults from tliis research. Comparisons 
vyere made between tho baseline condition and the combination of the feedj:.acl 
condition^. R.egarding the eflcct of feedback on mechanics, we found tliat 
although both groups improved m their use of punctuation and capitals, 
the group where feedback v/as directed tu mechanics improved more. As ^o 
the effects of feedback on content, t,oth jjroups showed about the .^ame anoun 



of improvement. The word per minute rates of the pupils remained about 
the same thrpughouf the study. In reference to, average sentence length 
iind the use of different words, the frea^uencies of these elements increased 
for most pupils irrespective of the focus-of the intervention. 

When the degrees cf feedback were compared^-partial vs. total—the 
differences were mixed. For^some pupils c ertain aspects of writing im- 
proved more during one condition, for some pupils other aspects improved 
mare during the other condition. 

Of some interest was the fact that mechanics was more influenced by 
feedback than content. This perhaps hus to do with the fact that content 
is moro difficult to define than mechanics, hence is more difficult to evaluate. 
Finally, in respect to feedback for mec>\anics» some creative writing experts 
have waiped about thiS practice. They have suggested that if mechanics 
arc heavily attended tc, crciativity will be inhibited. The contrary was the 
case in this study; feedback on mechanics positively influenced mechanics 
< nd content 

''To the Teacher." This project illustrates, aIon^» with several others, 
the nf^cessity for obtaining mi^Itipie behaviors in order to explain the dey.-lop- 
m^t of a complex skill, Ac.^:uggested in this report, enough behaviors 
should be S'-lectcd for daily measurement to provide an $ ' quate picture of 
the developing skill. One consideration m selecting those b-shaviors lias 
to do With calibraliofi. Some dir-cusiuon was provided on this topic earlier, 
which suggested that teachers mea.^ure behaviors that are being taugnt 
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Another consideration, incot.ir as selecting behaviors to measure, is to be 
certain that im portaDt behaviors are being measured, not merely behaviors 
that are easy to measure. The teacher must always keep in mind that measuxc- 
ment of studtint behaviors is not an end of it.self . Measurement merely allows 
the teacJier to determine whether she is teaching what cshe intexided to teach.. 
The skills the pupils develop are of ultimate importance. 

/inothor puint brought out in this proiect is that often, when teachers 
desire to assist pupils to acquire certain tasks, several individually derived 
teaching procedures are necessary. In this project, as pointed out, a feed- 
back technique assisted the pupils to appi'oach competency, but they certainly 
did not totally master the' fine art of writing, not even in regard to mechanical 
usage. The teacher, even though she may have found a successful teaching 
technique and the pupil is currently making progress, must continually 
monitor her efforts and file away techniques that could be used in the futui^e. 
A creative teacher must always be on the lookout for individually designed ^ 
teaching techniques. She must ama^ a huge repertory of potential interven- 
tions . 

Instructions were used to incre ase verbal behaviors .'-^-^ The pupil in 
this study was a 9-year -old boy. His speech was very difficult to understand. 
When a speech therapist attempted to pinpoint more precisely^his problem:., 
he was unsuccessful. The boy did not consistently misarticulate any sounds 
and' Ije did not stutter. At times his voice was husky and his speech very 
rapid, but neither poor quality nor excessive rate appeared to be p<»rsi&tent 
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characteristics. He did use ghettoesc speech at times and occasionally resorted 
to current adolescent jargon and even u^ed words and phrases of his own 
invention. Since we could not pinpoint specific verbal behaviors, yet believed 
we should improve his speaking, we decided initially to focu^ on sheer wprd 
output. 

Th^s study used a pre- post-test and « multiple baseline design. Pre- 
and post-tests were administered before and after several daily measures 
were obtained. Throughout the period of daily measurement a multiple baseline 
design was used 

Before the daily measurements began, the bey was asked to describe thrr;e 
pictures from a Peabody Language Development Kit. His descriptions of these 
pictures began with the phrase, -'This is." We, therefore, decided to measure, 
throughout the daily sessions, the ratio of different sentence beginnings as 
well as the average number of words, per response. 

Throughout the investigation the daily se^^sions lasted 10 minutes. Picture 
cards were presented to the pupil one at a time. During the baseline phase the 
pupil was instructed to tell about each card. Fe could respond to each card 
as long as he wished. The data in this condition indicated his average number 
of v/ords per response was four, arvc} his rr tio of different sentence beginnings 
was lov.'. If a picture of a cup was shov/n his response v/as,^"Thi3 is a cup/' 

Eased on these data our decision, during the next phase ; was to try 
to alter the ratio of sentence beginnings. Before each session in this piiase, 
the boy was told to use different ways to begin sentences. He immediately 
comphcd; through-put that phase his beginninrs v/erc grai.i^yingly varied. 
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Meanwhile, in this phase his average response length vas^only slightly in- 
fluenced; most of his responses were four to six words. 

Therefore, during the third condition, the pupU wr.s still instructed to 
vary his sentence beginnings, but, in addition, to use more words. He again 
■complied. The data revealed that his average response Icr^gth doubled, while 
his ratio of sentence beginnings remained hir^h. 

Following this condition a post-test was scheduled. The pupil was re- 
quired to describe the same three pictures used in the pre-test and three 
others he had never seen. During the post-test, on both sets of cards, ""he 
used over three times as many words as he had during the pre-test. Thus, not 
only did instructions influence his verbal output throughout the daily sessions; 
this characteristic generalized also to a different situation. 

During the final phase of the study, following conditions where the pupi 
had been successively instructed to vary sentence beginnings and to U3C more 

words, no instructions were given. Throughout the^ sessions the examiner 

/ 

simply showed the pupii a series o£ cards. The data from this phase were 
extremely variable. His beginning ratio was high one day, then low the 
next. His oerformance in regard to frequency of words was nist as^m'consis 
ient. Su.ce he had previously been respon-ave to in^structions. it was now 
as though he was exploring, trying to determine what the examiner wanted 
him to do. 

"To the Teacher,'' In schools and clinics many and varied instructions 
are used in efforts to teach children. These instructions arc intended to .-<-.-ve 



many functions. They are used to inform pupils which responbc to make. 
Pupils are requested to walk, run, sing, writ6. Instructions are employed 
to tell pupils how to respond. They are asked to walk more softly, run faster, 
sing louder, write more neatly. Furthermore, instructions are us<A to inform 
students when to respond. They are. told to periorm now, in five minutes, and 
when the bell rings, tomorrow. 

Sometimes these instructions are effective, sometimes not. Many children, 
like th^ pupil in this study, v/ould do what was expected of them if they just knew 
what it wai:. Often vhen instructions are used, ihey are not precisely stated or 
consistently given. Some children have been instructed to 'do better work," to 
"tliink before they act," to '^improve their performance,"' Such directives may 
only confuse children; their efforts, following such instructions, may be erratic. 
At other times instructions are clearly stattid, but not consistently administered. 
In a writing session, for example, perhaps one day the teacher requests 
more words, the next day neater writing, then more imaginative content, 
ihen ''watch the capitalization", or "be careful of the punctuation." Although 
some children can cope with such a barrage of instructions, others flounder. 

Studi>^s such as this which show that certain behaviors can be influenced 

by carefully given instructions, should be encouraging to tenciiers who are 

trying to influence the behaviors of children. It would appear thai if the 

i 

student is capable of performing the rerjuested skill, the i>i a..rmpt *p 
stimulate that behavior should be a clearly stated instruction. Furthermore, 
if that beh<tVior is desired over a period of time, the Svime instruction (s) ! 
should be given . 



Obviously, other teaching techniques should be used with the non-motivated 
student, the one who can perfcrm the requested task but won't. One recommended 
technique would be to couple instructions with remforcement contingencies; ask 
for the bahavior and pay off v/hen it occurs. This technique was used m an 
arithmetic project described earlier. 

Instructions should also be couplea vMth or supplanted by other teaching 
techniques if the desired bahavior is not in the pupil's repertory. If, for example, 
the pupil was requested to say the sound of c or add the digits 2 + 2 =^ [ 1 and 
had never done so, instructing him to perform these tasks might be futile. 
Some other form of prompting those behaviors, such a^j rr^Jeling, v/ouid ox course 
be recommended. 

A final point to be brought out from this study refers to pinpointing. The 
first task of the teacher setting out to change some behavior is to pinpoint tht- 
'behavior that should be altered. Next, that behavior should be measured |nd, 
if necessary, an intervention should be arrar.ged to alter the behavior. Measure- 
ment should xhen, of course, continue in order to determine whether the pin 
pointed behavior v/'\s in fact altered. 

Som*etimes, however, tt is net appai ent which precise behavior should be 
changed Although the toach.r knows somching is not quite right, she is unablcr 
to put her finger on the problem, S)ometitf\^s in cases like this,vthe teacher will 
cojisider the matter over a long period of time and lament the fact she cannot 
isof:.te the important behavior. No attempt will be m'xde to Crjange the behavic r. 
I believe i more productive strategy, in cases like this, is tc* btudy the situation* 
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a certain amount of time in du cffut t to isolato elm Scht*viur iif cotirr»v£i. Th«n, it" 
the problem is not obvious, something should be changed in an attempt to improve 
the situation. When such a strategy is followed the general behavior could be 
improved or the "real" behavior of concern could emerge. Such an approach v/as 
taken in this project. Although the teacher evaluated the boy's speaking as poor, 
he did not know which speech element was inadequate and needed correction. 
Rather than prolong the search for the key behavior, the teacher changed two 
aspects of the boy's speech that could be pinpointed. Once those behaviors were 
changed, the teacher reevalurited the boy's speech and decided it had, in fact, 
improved. 5* ' ' 

Pupil Mana gem ent Research 

Pupil selects either math o r reading . " This study was designed to 
determine the effects of selecting either reading or mathematics on performance 
rates in those two activities. The project was conducted with two boys, one eight, 
the other twelve. 

The first pupil was permitted to select whether to work on mathematics or 
reading for a 20-minute session each day. The mathematics materials was from 
Suppes Book 2A, while Book 7 of the Sullivan materials was used for reading. 

Following this period of pupil selection, two teacher-selected periods were 
sch^du^ed. During the first such perioct, the pupil was required to continue for 
40 minutes ui the academic area he ha'd chosen during the pupil-select period. In 
the third period, which lasted for 60 minutes, the alternate academic material wis 
scheduled. 



The secpLience ox periods for the second pupil diiiercd. In the Urst period, 
one of teacher-selection, he was aiternatoly programed either mathematics 
or reading for 30 minuteb eacli day. Mathematics was supplipd from Suppes 
Book 3B and reading from the Sullivan Books 19 and 20. ^ ^ 

In the second period, which also lasted 30 minutes, he was allowed to 
select either reading or mathematics. Finally, for the 30 minutes of period 3. 
the boy was assigned the academic matei-ial alternate, to tliat presented in period 
1. 

Three calculations wer obtained oach day, cne each for mathematics and 
reading when the teacher selected the program, and one from the pupil-^elect 
period. The results for the first pupil revealed that on 24 of 26 days, his 
performance rate was g^'^^t^^' when he_ selected the subject than his rate on the 
same program when it was selected by the teacher. The performance of the 
second boy was similar, m that duiing 17 of 25 sessions his correct rate w-is 
greater when he selected than on the same material when the teacher selected. 

For those two boys it appeared that self-selection was a motivating variable 
Being allowed to select, even between two relatively low-strength tasks (mat!ie- 
matlcs and reading), was for rhem a reinforcing event. 

*'To the Teacher/* We ha"^^e conducted a nuifiber cf pupil-manaaement 
projects during the past fev/ vears that have focused on vai iOus management 
components. In seme, the pupils have graphed their ov.'n data, m otherj {)ui->.l-^ 
have specified their own performance objectives and designed their O'.vn dailv 
schedules. Projects have been conducted wherein pupils timed th^'ir pcrf<;nra!iC' 
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'* counted ^l^nd'' corrected their responses. In a recent project a pupil selected 
his own instructional technique. In the project that follows, a young'^man 
designed his own contingency system . . - 

Invariably, these iJ>rojec^ have shown that pupils a^re motivated when 
they arc given a piece of the action. • This motivation is indicated by the fact 
that durijng those conditions under which thty are partially responsible for 
their behavior, their performances ar$ generally better than when the teacher 
manages the efitire situation, * 



13 * 

Pu pil specified contingencies in academic areas . This experiment * 
was concerned ^with^he corrparatiye effects of teacher- or pupii^specified con- 
tingencies. The pupil in this experiment was a IZ^year-old hoy. The investi-^ 



gatioji consisted of tliree separate studies — two- that manipulated the contingency 
manager and one that manipulated jnagnitude of reinforcement. Each study 
used an ABA design. Throughout these studies the boy received points for 
academic responses. In reading he was granted two points for each correctly 



i^ead page. That ratio was 1: 2, The ratios in the other academic areas varie^. 
*Point5f \w^re redeemable^ for minutes <of free time. 



'During Study 1, basoxine data relevant to the pupil's academic response 
rates were o)5tair\ed foi- nine days. Each day a^response rate figure was cal- 
culdted that represented Jhe boy ^s perforn^ance in all of his subject matter 
areas. Throughout this period no attempt was made to explain to the student 
th*e re^ponse-per-pomt ratio in euch academic area. 



^ Following this baseline period; the next%hase of the study was instituted. 
It was the intent at thi^ tirrTc to instruct the pupil about the relationship between i^ 
correct answers and contingent points. EacH day, in this condition, the teacher . ^ 
.verbaily explained the contingencies and placed ^written copy on the boy^s 
' desk. The contract was composed of nine agreements, each of which had a 

\ ■ ■ ' • 

response-per-point ratio. For example, the pupil was granted two point? for 

each page read and' one point for 10 correctly answered problems. As lie com- 

\ - . ' 

pleted each academic assignment, he was shown, how many responses had been 

made and was asked, to calculate how many points he had earned • 

It! the next condition,* the copy of the response-per-point requirements was 

removed from the pupils desk. He was now asked to specify his own payment folr 

tac.h of the nine areas. These new specifications were copied on a card and . . 

attached to his deskV^Flnally , in the last phase, the teacher-imposed contingenci^>s 

were again irv^f feet . ^ 

During the next quarter Study 2 began. Procedures for this investigation 

were exactly like those in Study 1. Teacher contingencies were explained, 

wi*itten but, and attached to the stucJent's desk in Ph<ises 1 and 3, while during 

Phase 2 the pupil's contingencies were in efffect. Figure, 4 illustrates the 

data from Study 2> • ^ js^ 



Figure 4 About Here 



Following this replication study, Study 3 was conducted. Since^during Study 
2 the pupil had altered all the teacher imposed requirements to grant himself 



more points per response, it was necessary to determine whether being able to 
specify his owri^ntingoncies had effected the academic increase or whether 
this gairt was due to the increased payoff. Study 3, therefore, consisted of 
thr6e phases: a) the teacher specified the response-per-point requil-ements 

7 

she had placed in effect throughout Studies 1 and 2; b) the teacher specified the 
requirements that the pupil had instituted during Study 2; /and c) the teacher 
again specified her original requirements. The only differ*^nce .between Studies 
2 and 3^as that in Study 3 the teacher imposed the contingency requirements 
throughout, whe>-eas in Study 2 the pupil set* his own contingencies during 
Phase 2. ' 

The data from these experiments indicated that, for this boy, selfrspecified 
contingencies were associated with increased academic rftsponse rate. /This was 
evidenced in Studies 1 and 2 since during the periods when the p\ipil '^iJo^iHefr the 
contingencies his median performance rate was higher than during the periods* . 
when the teacher imposed the contingencies. In addition, the. data from Study 3 
revealed that fhe response rate was due to ^le contingency manager and not to 
reinforcement magnitude since' his rates were about the same across all phases. 

«^To the Teacher/" Teachers should, for several reasons, consider training 
their pupils to manage certain of their own affairs. One reason was mentioned in 
the preceding projcet. That is, pupils ar<i often motivated when allowed to as:;uTie 
certain responsibilities for their own development. Another important reason for 
teaching pupils to managt! certain of their behayiors is that they can assist their 
teachers. In some classrooms children have. been taught to calculate the time thf-y 
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spend on certain programs, to total their correct and incorrect answers, chart 
their*rates, anji evaluate their own performances. 

Another 'reason for developing pupil^management skills- relates to the aca- 
demic curriculum. 'When children are taught to correct, count, chart, arid v 
evaluate their own performance, they are learning in functional ways to add, 
divide, tell time, and compare. The amount of pupil involvement and the extent 
to which this involvement is incorporated into the math and science curriculum 
is dictated only by )the ingenuity of the teacher. 

Obviously, the primary reason for teachir.g pupil management behaviors is 
that by so doing, pupils could emerge from schools as independent, productive, 

r 

and creative citizens. To train such students should, I believe, be one of the 
primary objectives of ^ducarion. ^ ^ 

e 

EPILOGUE 

CuA*ricuiuTn research, particularly when Applied Behavior Analysis pro- 
cedures are used,. is a very exciting adventui'e. It is extremely reinforcing to 
id^mtify important beiiaviors, arrange various techniques and procedures in 
efforts to develop those behaviors, then be informed daily abouL the function of 
those \'ariables. 

That Applied Behavior Analysis procedures are suitable for carrying out 
curriculum research has been demonstrated, not only by the varied projects 
reported here» but by several researchers throughout the country. A tremendous 



\ 



amount of work, however, remains to be done. The state of the art now >*egarding 
the use of Applied Behavior Analysis procedures and curriculum probably 

> 



corresponds to the degree of sophistication existing 10 years ago when beliavior 
modification pioneers were adapting operant techniques to alter talk-outs and 
out-of-seats in classrooms. 

In the basic subject matter areas many more investigations should be con- 
ducted • The behaviors measured in fhe subject areas reported here were the 
simplest and most fundamental. , In -reading, for example, projects were in- ' 
eluded that dealt with phonics behaviors, oral and silent reading, and some 
types of comprehension. Future research could identify more complex reading 
behaviors such as paraphrasing stories, integrating material read from several 
sources, criticizing stories. 

Our measures* m arithmetic were similarly fundamental, various types of 
computatipn and story problems. A great deal olwork remains to be done in 
the latter area. Research should also focus on other aspects of mathematics 
such as time-telling, measuring, sets, and unions. 

In spelling, future researchers need to focus on the matter of sequencing, 

« 

whic)i words or letter combinations should be taught before others. Spelling 
researchers also need to identify which teaching techniques seem to.be most use- 
ful for certain types of words. Our work in typing is but a beginning. In that 
research we followed closely the sequence of activities from a commercial book. 
Perhaps by using Applied Behavior Analysis techniques researchers will be 
able to identify a belter sequence of tasks ancl more effective teaching procedures 

In penmanship some of the basic issues, including the development of * 
manuscript before cursive writing, remain to be resolved. Applied behavior 
analysts should focus on such issues. Persoi :illy, I believe that although the 



penmans^iip questions have not been answered, there are other curricular ques- 
ts • 

tions of far more importance. 

' Creati^'e writing offers a wealth of possibilities for the innovative Applied 
'Behavior Analysis researcher. Curriculum researchers ara perhaps the farthest 
awayTfrom identifying the important behaviors of writing and the technique^that 
will develop those behaviors than ir) any other area. 

Not only does a fair amount of research need to be done by the applied 
behavior analyst in the basic skills just described, but other, perHaps more com- 
plex, subjects must be investigated. There is little, if any, research of the 
Applied Behavior Analysis variety in such areas as social studies, science, art, 
music, history, geography. 

The question arises, v^hose obligation' is it to conduct tLis research? I 

A 

believe tHe primary i^esponsibility, rests with research facilities such as ours. 
, Teachers can ill -afford to spend time researching the effects of various instruc- 
tional techniques or identifying behaviors that are measurable. They are in the 
business of developing behaviors. It is the researcher's responsibility t^investi- 
crate current curricular -oractices in schoofs. The researcher is also responsible 
for suggesting curricular innovations based on his investigations. 

ViA-ther, it is the researcher's responsibility to present his findings^n 
such a way teachers can incorporate them in their daily routines. Throughout 
this chapter I have attempted to present research so certain elements could be 
ustul by teachers. The approach was to synthesize several projects and follow 
each with specific suggestions about which aspects could be assimilated. 
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Finally, once the cuiriculuni researcher has identified important areas for 
investigation and clearly presented his findings ; it is up to the teacher to blend 
those findings with her basic technology. As I mentioned befoi^e, the creative 
teacher is one capable of extracting various elements from resear^^h projects and 
modifying others so they are functional in her situation. 

r 

Teachers will develop in proportioti to the extent they can generalize. Some 
third grade teachers are willing to learn from only other^third grade situations. 

To them, research or clinical evidence fron other situations is not relevant be- 

' \ \> , ^ 

cause of the different setting, type of feub. cct, behavior; measur ed, or remediation * 
technique. These teachers deny themselves many learning opportunities. 

The teacher most capable of growth can extrapolate from many situations, 
some quite different ^rom her own. It is my hope. that teachers can generalize 
from the studies in this chapter, even though most of the research was conducted 
in a laboratory setting with learning disabled children. 

Many teachers of mildly handicapped, even normal, children should be 
able to incorporate certain of the suggestions from this chapter regarding the 
^trrangement of materials, designing of materials,* diagnoisis, error analysis, 
selection of teaching techniques. Several of the moi;e general notions, for .example, 
those in reference to various reinforcement arrangements, should be applicable 
to a wide range of individuals^ 

The reason for tfie wide extrapolation potential of the research from this 
ch?.pter is that Applix^d Behavior Analysis techniques were used. When this 
approach is used, explicit behaviors are dealt with in a straightforv^ard manner- 
Generalization in thif^ context, therefore, pert^ns to identifiable environmental 



relationships, For instance, a teacher of neurologicaliy impaired children Identi- 
fied a boy whose penmanship skills are inconsistent. One day his writing is 
beautiful, the next terrible, the next fair, and so on. Following a baseline period 
the teacher arranged a withdraw-of-positive-reinfor cement procedure, similar to 
the one used in a math project reported here. For each incorrectly fdrmed letter^ 
the boy iost 30 seconds of shop time, Althougl?'there were many procedural 
differences between the penmanship and math project (sex, type of pupil, subject 
area, reinforcer), the teacher generalized the important environmental relation- 
ship from the math project to her spelling situation: contingent on errors, rein- 
forcement was withdrawn. 

Thus, researchers and teachers are granted two tremendous advantages 
when Applied Behavior Analysis techniques are used. First, '*n response to 
educational researchers, when these techniques are used most all the feattires 
of educational curriculum can be studied. Se.cond, in response to teaqhers, when 
the concept of generaiiaa^tion is derived from the Applied Behavior Analysis approac 
teachers are provided With infinite opportunities for developing their instructional 
skilly. - ' ^ 
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FIGURE CAPTIONS 

Correct an<d incorrect rates throughout two phases as the boy 
^read from a Ginr\ and Lippincott text. The numerals in the 
tear drops indicate correct and error rate means. 

Percent cdrrect scores for the three a.uthmetic sheets through- 
out the smdy. The data scores on and were 
erratic during baseline. Furthermore^ the withdrawal tech- 
nique was successively effective on each sheet of problems. 

Correct and incorrect rates of writing synibols throughout 
four experimental conditions. For tlie first ^ix days the 
pupil alterna\.d between manuscript and cursive writing. 
Throughout the first condition no quality control^ was arranged; 
throughout subsequent phases the correct-the-next-day con- 
tingency was arranged, then removed. Correct rates generally 

V 

improved throughout the study. Terror rates were greatly 
influenced by the contingency^ when arranged, the error 
rates were low, when not arranged, the error rates were * * 

\, " ' ' 

high. - .. , I 

Response rates throughout the three conditions of Study 2 
(Experiment il) . These data indicate the pupil^s rate- was 
hij^her during the condition ti>at he specified the contingencies 
than when ^ipecified by the teacher, ' - 
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ROUND OrJE— PLACING THE CHILD IN THE RIGHT READER 

Thomas C. Lovitt and Cheryl L. Hansen 
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ABSTRACT 

^ A method for placing children In readers was devised and implemented which 
combined aspects of the Informal Reading Inventory with techniques developed by 
applied behavior analysts. Using this method three reading behaviors of pupils 
were measured directly an<J frequent ly^-corfect oral reading r^te. Incorrect 
oral reading rate, and correct comprehension percentage. Seven intermediate 
age boys with reading problems read and answered questions from t^ooks D through 
K of the Lipplncott series. They read five 100-word segments from each reader 
and answered six comprehension questions from each segment. \ 

Each student was placed In a reader based on his three performance 'scores 

\ 

during this period. The effectiveness of the placement method was judged In 
terms of how well It predicted subsequent reading performance In the , students* 
Instructional readers. 

Two major findings resulted from this study. First, although oral reading 
rates and comprehension scores generally worsened as the grade level of the 
material Increased, the performance differences between adjacent books were 
minimal. Correct i"ate\tfas more sensitive than either incorrect rate or com- 
prehension percentage to ch^ges In grade level. Second, after placement In 
the readers, all the students ^progressed satisfactorily throughout the remain- 
der of the year. 
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ftOUND.ONE.—PLACING THE CHILD' IN THE RIGHT READER* ' • 

Thomas C. Lovltt^ and Cheryl L. Hansen^ 
University, of Washington 

^ The first concern of the teacher of reading is to'place her students In ^ 

readers. Once an Interesting and motivating series^of books has been chosen, 
. on whatever .basis, each pupil must be assigned to a specific book in that se- 
ries that will assist him to become a competent reader. The pup.il should 
neither be placed in a reader that^ is too easy nor in one that Is too dlffl- 

^ ^ cult. Although most teachers agree with this' concept , there is liltle agree- 
ment as to how pupils should be placed in readers^that are, for them, ''just 

* right." ^ . 

Currently, there appear to be four methods for placing children liT^a^Ing 
texts* Some teachers place children on the basis of chronological age or grade. 
Others use achievement tesfs, publishers' basal reader tests, or Informal Read- 
ing Inventories (IRf). 

c 

- . The most casual method for placing children is to assign them texts which 

correspond to their chronological ages or grades. According to this approach, 
rf a chTtd is eight or nine years old and In the third grade, he would be 
placed In a third grade reader. This placement method has tKe least to recom- 
mend It; for ability is often unrelated to either age or grade. 

• A second placement method is to. assign pupils to certain texts beca\jse of 
their achievement test scores. The problem with using this approach Is that 
achievement test scores are often indirectly related to the performance of pu- 
pils in the classroom; and furthermore, achievement test scores are Infrequently 

gathered {Lovitt s Eaton, \37h). Indirect refers to the fact that a pupil might 

* * 

be expected to respond to an item of one type on .an achievement test, e.g., 

ERJC 1';; 



answer a certain type of comprehension question, but is required to do something 
quite different in the classroom, e.g., read orally. Infrequent simply refers 
to the fact that achievement tesfs are given only once or*" twice a year. The 
problem with such a strategy is that single impressions of performance often 
misrepresent a person's ''true'* ability. 

A third method for placement is to use the reading placement test which 
accompanies certain basal reading series. These reading tests, although quick . 
to administer and directly related to the material used during subsequent in- 
struction, are generally given only once. As we mentioned, one test score, 
whether it is from a direct or an indirect test, does not always reveal the 
true ability of an individual. 

A fourth approach used t;o place children in readers! is the Informal Reading 
Inventory or IRI (this technique was fi rst' recommended by B^tts in 19^6). When 
the IRI method is used, a pupil is required to read orally or' silently from a 

series of reading pa^^sages arranged in orddr of difficulty; pre-primer, primer, 

12 1 ' 
first reader (I ), 1 , 2 . Ordinarily, two reading sicills are assessed at sev- 
eral levels: word recognition and comprehension. The pupil's percentage scores 
for those tasks across the levels are calculated and compared to normative 
scores. The pupil's scores for each reading component across levels are then 
transformed to one of three competency levels: independent, instructional, or 
f rustrational . The pupil is then placed in a book where his scores indicated 
the "instructional level." 

From the point of view of the applied behavior analyst, the IRI placement 
method has much to recommend it. When an IR! is used, the pupil's performance 
is directly measured, for the reading material is the same throughout testing 
and instruction. However, as is the case when achievement tests or publishers' 
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tests are used for placement, generally only cirte readlng sample from'e^ach level 
Is obtained, when the IRI procedure Is used. As mentioned earlier, when only' 
one sample ^of a person's performance is obtained, a dlsforted Impression of his 
ability could be presented^ hence a pupil could be Inappropriately placed. 

In the present study, a reading placement method was devised and Implemente^d 
which combined some aspects of the IRI (direct measurement across many level s)| 
with the techniques developed by applied behavior analysts (direct and' frequent 
measurement).' Using this approach, three reading behavlprs were -measured for 
several days from several levels of ^tbe reading series that was ultimately used 
for instruction. It was our intent to place children In the highest reader 
posslble*-a level where they wouW^be motivated but not frustrated. Further, 
.it was our Intent to place children Jn readers on the basis of their performance. 

. ' \ , ^ ■• • - 

ME^THOD 

Subrjects 

The pupils in this study were seven boys between the ages of 8 and H. 
They attencjed the Curriculum ftesearch Classroom, Experimental Education Unit, 
Un i ve rs I ty' of 'Wash i ngton . 

The boys were referred to this class by a, suburban, upper-middle class 
school district near Seattle because of ^^arning disabilities. At the time of 

r" V . 

referral the students were frqm one,to. thre'j^e^xa behind their peers in reading, 
math>>Snd spelling. AIJ pf them bad, .at one time or anpther, received remedial 
reading Instruction. , ^. 

\ 

sM 

subjects which included reading and comprehension, to the extent they were at 



Our goal for the s,tljdeirts,^ui^lng their one year's residence at the Cur- 
ri^dcrttfm Research Classroom, was to alter. their competencies in the basic skill 



grade level. The, study was conducted during late September and early October, 
1973- . ^ 

Material Selection .and Preparation 

The ifpplncott reading series (McCracken ^ Walcutt, 1970) was; used for 
reading placement and Instruction. The Lipplncott series utilizes a lettering 
system to, denote grade levels. Book D Is the first grade reader, Books E and F 

are second grade' readers. Books G and H are third grade readers, and Books I, J, 

/ 

and K are fourth, fifth, and sixth grade readers. 

F.lve samples of. oral reading and comprehension wer^ col lected from each 
reading level. Each student read five 100-Vford segments (the first 500 words) 
from the first story from seven of the eight reading levels. In the G reader, 
the pupils read the first 500 words of the second story because It was believed 
the first story, ^'Hansel and Gretel," was too well known .to the' students, and 
because of this, their performance could be affected^. * 

Six comprehension questions per each 100-word segment were written.- These 
questions pertained tp four aspects of comprehension: recall, sequence, rnteir 
pretation, and vocabulary. Recall questions dealt with facts frcm the story; 
for example, **Where did Danny Morgan live?" Sequence questions pertained to, 
the temporal ordering of events; for example, "What did Danny want to do af^er 
he and his father rode to Lookout Point?"^ Interpretation questions Included 
synthesis. Inference, translation, and application processes; for example,- "Why 
didn^t Brick Morgan like the Indians?" For the vocabulary aspect of comprehen- 
sion, the students were told a word and were then asked to select a synonym for 
that word from a choice of four other words. The first three types of compre* 
henslon were assessed from levels D through H. All four types of comprehension 
were measured from Books I through K. 



Dally Procedures 

Reading placemetit was carried. out on an Individual basis In a small room ^ 
adjacent to the main classroom. At the beginning of the study, each student 
was told he would be asked to read orally and answer questions from several 
books In order to determine which reddlT>g tevel was best suited, for him. He 
was asked to try his best as he read the various selections 'and not to worry if 
sofTie passages were difficult. Each student spent about 15 minutes reading per 
day over a period &^ two weeks. 

The order In which the pupils read the books varied each day. On the first 
day of placement a student read the first 100 words and ar^swered comprehension 
questions from the following four readers: D, F, H, and J. On the next day he 
was assigned the first .100 ^i^ds from Books K> I, G, and E. Different arrange- 
ments were, used the pther days; Generally., four to six segments were read each 
day, until all ^0 segments had been read. ; 

During the oral reading* .session the teacher tallied the number pf correctly 
and incorrectly read words. Incorrectly read words Included omissions^ substi- 
tutions, additions, mispronunciations, and hesitations longer than four seconds. 
Proper names and places, repetitions, and self-corrections were not counted as 
incorrect responses.' If the Student tbuld not pronounce a word or mis- read a 
word he was told that word and encouraged to continue reading* Comprehension 
was- checked' dfter each 100**vVord segJnent was read, the' teacher read the c|ues- 
tions and "the student answfered them orally. ' , 

Following each reading session tK6* 'teacher calculated thre.e pieces of data 
from each segment: oral correct words per .mlnujte (wpm) , oral incorrect' wpm, 
and percentage of correctly answered comprehension questions. The first two 
figures were obtained by totaling the number of correctly and incorrectly read • 
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words from each^segment . The third figure was obta^ined by dividing the number 
of correctly answered questions from each segment by the totals (6) . 

EVALUATION ' , - : 

In order to make a placement decision for each child., mean correct and In- 
correct oral reading rates, ^nd average percent, correct comprehension scores 
for each reader were computed. The mean correct rates per level for each stu- 
dent are Indicated In Figure K An examination of these data revealed that, ^n 
general, an Inverse relationship existed between correct rate and grade le^el. 
In 7(>%^of the cases, as grade level Increased, correct rate decreased. All 
^'udents had higher correct rates in Book 0 than In Book K. On the a^rage, 
their correct rates were 27 wpm higher In Book-*0 than in Book K. In Book 0, 
the group averages was 58.3 wpm^, whereas the group average In Book K was 31 - 
wpm. 



insert Figure 1 About Here 



An analysis of the mean Incorrect rates of the students general ly,, revealed 
a positive relationship between incorrect rate and grade level.. In S3% of the 
cases, as grade level increased, mean incorrect rates Increased. Figure K ' 
shows the mean Incorrect rates for each student at reading level" AH of 

the students had lower incorrect rates in Book D (mean » 5^^ wpm) than in Book 
K (mean « 6*.9 wpm). On the average, incorrectly read words increased 1.5 wpm 
^between Book D and Book K. 

The- comprehension scores of the studervts was to some extent aff^eiKby 
the grade level of the materials. Figure 2 indicates the mean percent"c/mpre- 
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henslon scores In Bopks D through K for each student. In ^]% of the cases* an / 
Inverse felatjonship existed bet^eprr comprehension and grade leve\». . Ti;ie average 
comprehension score was 30.3^ higher In Book 0 than !n Book K. vThe. average com- 
, prehension score in Book D was 9^.6%*, end the group average in B^ok K wa? 6^.3*. 



Insert Figure 2 About Here 
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~^-^tn sunvnary, the abilities of most pupils to read orally and comprehend were 
Adversely Influenced as grade level Increased. This performance decrement, frxm) 
one level to the next was most obvious when correct reading ratB was- considered. 
%s gr&de level Increased, cprrect • ratet decr^as€fd 76% of the time/ incorrect rate 
rose .in''53^ of the Instances, and correct comprehension percentage^ fell. 5il^ of 
the time. • ^ ' . ' ^ - ^ • . * 

Although the ability to read lessened .as grade level inpreased, ,th^ Jecre-* 
ment between adjacent reading Jevels was often slight. In. over 50% of the . 
Instances, the differences between the correct rate. Incorrect rate, and^comfire- 
henslon means of adja^cent reading 4evels was less than five "correct wpm, one In- 
correct wpm, and 5% comprehiensioh. 



PLACEMENT - • 

^ After an examination of the previous' year 's rieading data and the progress 
made by those seven students, we determined the guidelines for placing the cur-? 
rent group of children. We decided to pjace a student In the highest level 
readex In. which his average correct rate was between ^5^65 wpm, his averfjge^ irr^ 
correct rs^te between wpm, and his average comprehension score between 50^-75%^ • 

Our Ini tial ,cQjisideratlon for placement was the pupil's average correct 
rate. We next studied his mean jncorr.ect rate, therj his Average comprehension 



score. Usinft this approach, the mean correct rate for the seven boys in' their 

\ ^* , ' . . 

assigned* readers was ^8.0 wpm (range from ^5.5 to 53*^ wpm) . the median incor- 
rect r^te for the group was^.9 wpm (range from 3.1 to 7*0 wpm). With one ex** 
ceptioh, the incorrect rates of the boys In their instructional readers were 
within the desired limits. 

In certain instances we were unable to use our comprehension criteria^ be- ' 
cause the level of comprehension exhlbi'sd by the students was often highe)^than 
75%. The mean comprehension score for the boys in their assigned readers was 
S6.7* (range f rom^ 55 to 95'.8|). 

Utilizing these placement criteria, the students began their instruction 
in various Lipplncott readers. One student began fn each of Books D, E, H, ^nd 
{. Three stuidents were placed in the F reader. 

Figure 3 shows the placement da*-a for one pupil. In the top graph are his 
oral correct and incorrect rates for^ the el^ght readers. In the bottom graph 
are his percentage scores for answering comprehension questions. Using our 
placement criterion, this boy was placed in Book D. 

V 

Insert Figure 3 About Here / 



EFFECTIVENESS OF PLACEMENT METHOD 
The effectiveness of our placement method was determined in two v^ays. One 
fnethod was to compare the pupil's performance in his assigned book during place- 
ment with his performance in that same book when he read from it during the In- 
structional period. If the placement procedure was reliable, then little dif- 
fcrence in performance would be noted between the placement period and the base- 
line condition <the first condition of the instructional period). 
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After the instructlonaT reader for a student was Identified, he began read- 
ing and answering questions from only that book. Each day he read 500 words and 
responded, in writing, to 20 or 30 compr;hension questions, depending on the 
level of *the assigned reader* During the first seven days of the instructional 
period, baseline procedures were In effect. 

When .the data from the placement period and the baseline condition of the 

r 

instructional period were compared, we discovered that the correct rates of five 
students were lower during the baseline condition* Although the group difference 
between placement and baseline was only -1-6 wpm, the ^ndlvidual difference bet- 
ween the means ranged from -8.2 to -♦•11. 3 wpm. All the students had lower in- 
correct rates during baseline than during placement. The students had an average 
of -1.9 incorrect wpm less during baseline (range from -3.I to -2.9 wpm). These 
correct and incorrect rate differences could be attributed to the fact that. the 
pupils read from four to five 100-word segments each day during placement and 
from one *500-word segment during baseline. * v 

Six of the seven students had lower average comprehension scores during^ 
baseline. The average comprehension score for the group was reduced 15*^ from 
81. 5^ during placement to 66.9^ during baseline. These comprehension .percentage 
differences may be attributed to one or two variables. During placement, tiie 
students responded to six questions from four or five reading segments. During 
baseline they answered from 20 to 30 questions from one reading segment, ^ur- 
thermore, during placement the pupils responded orally to questions that were 
read to them, whereas during baseline they read the questions and wrote the 



answers. 



In summary, the correct and incorrect rates and the comprehension scores , 
were generally higher during placement than during baseline. Although the' ^ 
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correct^nd incorrect rate difference's were flight, the comprehension score 
differences between the two periods were rather significant. 

A second way in which we evaluated the effectiveness bf the placement - 
program was to assess the progress of the students throughout the year, once ^ 
reading instruction began. If the students were appropriately placed* their 
reading scores should Improve throughout the year. When the data from our stu- 
dents were analyzed it was apparent that'^all seven Students had progressed 
tKroughout the quartejc^ ^ Although one student did not initially exp^erlence suc- 
cess in his originally-assigned reader, his reading improved when he was changed 
from Book I to' Book H. It should be mentioned that'^ the pupil requested the 
change. ^ \ ^ 

After one quarter of instruction, the correct rates for all seven students 
had increased from tneir basel ine rates. These increases ranged from +6.5 to 
+1^.2 wpm. The average incorrect rates for four students decreased from base- 
line to end of ^the quarter. The ranges for thfe students were from -1,1 to +-5 
wpm. The a\/ej^ge comprehension percentage scores increased for all students, 
ranging from +6.2 to +19.3^. In summary, the students thrived after being 
placed in^'their readers. 

DISCUSSION 

The method used for placement described here has much to recommend it. f^or 
one thing, since the puoil.s in this study improved in reading throughout the 
year, we can assume they were appropriately placed. It should also be mentioned 
that throughout ^the year rather mild instructional techniques were used; progress 
was not the. result of unusual or expensive teaching practices. 

A second important aspect of this placement method is its general izabi lity. 
^Although the Lippincott series was used in this report, the sam^ procedures 
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could be used w»th any basei series or, for that matter, with any collection 
books. In this study three reading behaviors vyere measured that dealt with oral 
reading and comprehension. This same procedure for. placement could be used with 
pther j-eading behaviors. If, for example, a teacher wanted to place children in 
^readers\ on the basis of their silent reading rates and their abilities to-des- 
cribe freely the events of a story, those aspects cbuld be measured from several 
books for a number of days. 

The method -jsed here could certainly be improved and perhaps simplified. 
One improvement would be to use the same procedures during placement and instruc- . 
tion for assessing comprehension performance. 

Our p/acement method could perhaps be simplified.^ We had the students read 
five times from each level. Although we strongly support the notion of frequent 
measurement, perhaps three or four measures would provide 'data ac rclioblo as 
ours- Another modification could involve the selection of the reading ^segments. 
We had the pupils read from only the beginning of each book. Others could re- 
quire pupn;5 to read from various parts of the books. 

These modifications notwithstanding, the method described here, which fea- 
tured direct and frequent measurement, is assuredly a more reliable placement 
method than most of the others now In use. When the direct and frequent method 
is used the pupils, in effect, place themselves. Thq^are placed in readers 
based on their performances not because of their ages> grades, or scores from 
indirectly or infrequently administered tests. 

Using this method the pupil's chances for winning the important roun,d one 
of the reading battle are increased. Furthermore, w'^en direct and frequent 
procedures continue to be used for reading instruction, the likelihood is great 
that the pupil will remain In the ring for 15 rounds and emerge victorious. 
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FIGURE CAPTIOiiS 

< 

Figure 1. Each pupiTs average correct and incoi^-rect^ rates for eight Lippincott 
readers are shown. The numerals above the correct rates 'and below the in- 
correct rates are the mean of the means. 

Figure 2. Each pupil's average comprehension percentages for eight Lippincott 
readers are shown. The numerals below each collection ;jf scores are the 
mean of, the means. 

Figure 3. The top graph shows MF's daily correct and incorrect rates from eight 
Lippincott readers. The numerals above ^the correct rates and below the in- 
V correct rates are means for each book. The bottom graph shows the d^^ily 
comprehension percentages and means for the Lippincott readers. 
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THE USE OF CONTINGENT SKIPPING AND DRILLING 
TO IMPROVE ORAL READING AND COMPREHENSION 



Thomas C.Lovitt and Chery 
University of Wash 



^^L-. Hansen 



ABSTRACT 

In this study three reading behaviors were measured for several days: oral 
correct and incorrect rates and~ correct percentage for answering comprehension 
questions. ThVoughout a baseline phase neither an instructional nor a reinforce- 
ment technique was scheduled. During the second condition of the study, contin- 
gent si<lpping and drlllihg wereAnvol ved. if, during this phase, a pupil's, oral 
receding rates and comprehension score ^xc^eded criterion levels, he was allowed 
to skip several stories in his assigned reader. If, however, he did not skip for 
several consecutive days, drilling procedures were arranged. Following this in- 
tervention period baseline conditions were reinstated. The data indicated that 
from first to second condition every student's reading Improved In respect to 
correct rate and comprehension accuracy. 'The tncorrect rate performances of four 
students also improved. When the intervention was removed, during .the third . 
phase, the performances of most students maintained.. The average rates and com- 
• prehension percentages were, in fact, better during this condition than they were 
in the second condition. Subsequent studies were conducted in an effort to de- 
termine the effects of either component of the intervention, sklpping-or drilling. ■ 
Only, tentative remarks were made in-fhis regard. Recommendations to teachers of 
reading are offered based on the results of this study. 



THE USfe OF. CONTINGENT SKIPPING AND. DRILLING 

TO IMPROVE ORAL READING AilD COMPREHENSION' 

2 5 « * 

Thomas C. Lovitt and Cheryl L. Hansen'' 

f University of » Washington 

Once students are ready to read contextual material the first problem for 
the teacher df readingis one of placement* The teacher must place children* in 
readers jn. order that they may, in time, become competent insofar as decoding 
and comprehending written symbol s»^ In order to Increase t^e probability the^t 
pupils wj U , in fact,, learn to read, they must be placed In readers that arc, 
for them, **ju5t right," neither , too easy' nor too difficult. Pupils must.be 
challenged to progress, but should not be frustrated by material "ihat Ms too 
difficult. • ' \ 

Recently, we (Lovitt £ Hansen, 197^) designed a procedure whereby chi Idren 
were placed in readers on the basis of 'their performance. Direct and daHy 
measurement techniques were used, thus enabMn^ us to place children in certain 
readers on the basis^of their decodin^g and comprehending abilities. 

^Another n\ajor concern of teachers of reading is one of advancement. Once 

children have baen plated in readers and instruction has begun, hovf should tboy 

/ ' ^ ^ 

proceed through the readers? 

As is true of placement, several strategies are used by teachers to advance 
pupi [s^ through readers and from one reader to another.* Back In the olden day* 
when I ^^t^^g^Tt,** I used a n^thod for advancing pupils from one story to the next 
that is, 1 believe, still used by some teachers. I assigned all the pupils to 
various reading groups: jaguars, cougars, wolverines. The children In those 
groups took turns readjng the same story; one child read a couple of paragraphs, 

the next ,dhild a few more, and so on until the story was completed. We then 

i 



talked about th^ story. The next day a^. new stcry was assi'gned, 

Since that time sonne reports have been published that describe methods far* 
advaacing pupi l,s , through stories and readers on ^the basts of pupil performance, 
Gdmly and NittoU (1971), for example, described a process whereby students' 
were allowed to advance from one reading level to another If their comprehension 
scores' for several stories were greater than 70^. Starlin (i970), in a doctoral 
,dissertation, suggested that pupils should be advanced from one reading level to 
another when ^thelK correct oral reading rates were above 100 words perj minute 
(wpm) and their incorrect rates v/ere less than 2 v/pm« 

)n our study we have /combined the advancement ^crl ter ion of those two reports 

We allowed pupils to proceed f.fom one section ^of a book to another on. the basis 

\ 

of their comprehension scores and their oral reading rates* In fact, v/e allowed 
the pupils to' skip several stories iti their readers if, on the* same day, theii- 
three scores — oral correct rate, oral incorrect rate, and comprehension percent- 
age — were better than criterion levels. 

In this study we also incorporated a provision for those pupils whose scores 
remained low, and thf*-/ did rot skip* For those pupils, drill techniques were 
scheduled. 

Whether the pupils skipped rfiatcrial or were drilled, those features were 
contingent on their performance. Pupils were allowed to skip only when tn'iir 
reading abilities exceeded established levels, and were provided drill on^ly when 
their reading abilities were inferior to the established levels^. 

METHOD 

Subjects .and Seating 

The subjects for this research were seven boys, ages C-12. They were cate- 
* 

gorlzed as learning disabled by their school district, and also, according to 



them, the boys .wore from o^e to three years retarded In reading. 

The setting ("or the research was the Curriculum Research Classroom, £xperr 



mental Education Unit, University of Washlngtorvv The purpose..of^ this classroom"^ 

^ i ^ ' 

IS to qonduct educational research wjth elementary age children. 

»* * 

Materials ' , . - 

The Llppincott Basal Reading series (McCracken & Walcutt, 1970) was^ used 

■t - * , 

during this project. Each reader in the series was divided intj four ^ectidns 

i * 

(poetry and plays v;ere excluded). The stories Jr. each ectJon were then divid,ed 
into 500*-word segments. In those stories where the l^st segment was over 2i5 
words, that much was considered a separate segment. !f the last segment was 
less than 225 v/ords Itfose words were combined "V/i th the prejcedlng 500-word seg- 

ment.. » . * ^ 

\^ > 

The reason the books were divided i nto 'quart-ers will be explained later* 
^ ^ reason for subdividing the quarters intcj SOO-^word segments is that each day 
the pupils were required to read ^he^same amount of material. It was necessary 
for the pupils to read the same amount of material ^ach dayjn c der that t^ey , 
tould resf/ond to an equal number of comprehension questions daily. 

Comprehension questions were written for each 500-word segment* These 
questions were of four different types: recall, sequence, interpretation, and 
«^ vocabulary. From ♦:he first- to third-^grade readers^ 10 recall, 10 sequence, 
and 10 interpretation questions were written. From the fourth- to sixth-grade 
reader^, Z recall, 5 sequence, 5 interpretation, and 5 \/ocabulary questions 
were w.itten. Recall, sequence, and interpretation questions required short, 
written responses. A multiple choice format was used for the vocabulary 
questions. 
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ReliabMity • ' 

For oral reading, reliability checks were obtained ^an average of six times 

for each pupil. In'^prder to conddct these checks certain oral reading sessions 

' % ' T- ^ ' . * ^ 

were tape recorded. A second teacher then listened to 'the tapes and counted 

correctly and incorrectly read words. Reliability was calculated by dividing 

the numbeii of agreements between the two teachers by the number of disagrjeements 

plus agreements. This figure was then multiplied by lOQ. The average corre-rt . 

! * . > 

and incorredt rate reliability calculations were 98.0^.;^ \ 

Agreement for scof-^ng answers to comprtehenaion questions was determined by 

having a second teacher check a ^sample of 15 assignments for each pupil • Tiie 

formula for calculating or. reading reliability was us^. The average relia- 

bility for scoring comprehension answers wa^'99«6^« ' ; i 

Placement Procedures ' . . 

• ' The instructional reading level for each student was determined by using a 
systematic informal reading inventory (Lovitt and Hansen, 197^)* Ea^*-!^ Student 
VfTSri^ly read five 100** word segments f/om^all LippincQtt f Coders between levels 
0 and K (grades one through six). They also responded to comprehension questions 



from all these readers.^ ' ( 

After these Jata were collected, the mean oral cor'-jct and incorrect rates, 
and mean correct percentage scores for answering comprehension questions, were 
calculated fc||^each reader. Three scores, tl^en, were calculated for all the 
pupils from the eight readers. These data were then used to place the pupils. 
Each p'jpil was placed in the highest reader ?n v%'hich his average oral correct 
rate was between ^i5-65 wpm, his oral incorrect rate was between ^-8 wpm, and his 

average correct comprehension percentage was between 50-755^o. Using these cri- 

2 ^ 1 • 

teria, one student was placed in Book D (1 ), one in Bcjk E (2 ) , three in 

Book F (2^), and two in Book h (3'''). 



Interventions 

tn this study there were tvvo interventions, skipping and drilling. Both 
were arranged contingent on pupil performance. 

Skipping . After a seven^day baseline, average correct and incorrect oral 
reading rates and average percent correct comprehension scores were calcul^ated 
for each student. Desired performance levels were then calculated for the inter- 
vention phase based on these scores. Desired performance levels were defined as 
i^^Z improvement. For example, if, during the baseline, a pupil *s average cor- 
rect rate was 60 wpm, his average incorrect rate was 6 wpm, and his average cor- 
rect comprehension percentage was 70, the desired scores for those corresponding 
behaviors throughout the intervention phase would be 75 vvpm, ^^.5 wpm, and 07-5^. 
This 251^ improvement rule was used until the desired levels exceeded proficiency 
limits. Proficiency in oral reading was defined as 100 .correctly read wpm or 
better, and 2.5 incorrectly read wpm or' better. Our proficiency requirement for 
comprehension was 30% or better. 

When the skipping provision was In effect the pupils were Inforried that 
they could skip all the remaining stories in a quarter of the* book if, on the 
same day, all their scores equalled or exceeded the criterion scores. If our 
example boy*s oral reading rates were better tiiat. 75 and ^.5 wpm, and his com- 
prehension score v^as better than 87.5%» he would be allowed to skip the re- 
maining material in the section he was assigned to reed. 

Dr i 1 1 ing . Three types of drill were used, one for each ineasured behavior: 
oral correct rate, oral incorrect rate, and comprehension peVcentag'-i. For the 
correct rate drill, a student Wc^s required to read the last 100 v^rds from the 
previous day*s assignr.ont. he continued reading that passage until he could 
complete it at his criterion level. 



When the IncOfTect rate drill was used, the teacher showed the pupil a list 
of the words he^ had mis-read during the reading session. These words were em- 

bedded fn phrases from his reader. The student was required to rehearse that 

-"^ 

list of phrases urz\] he could read all of therr. correctly to the teacher. 

For the comprehension drill the pupil* s answer she^t was returned to him 
with the incorrect responses checked. The pupil was then required to rework 
his answers untlj they were all correct. 

* f 
PROCEDUR[:S 

As described eai Hi,r, each reader was divided into four parts. Before a 
pupil read from each part he was given an opportunity to skim through al! the 
stories in that group. He then told the teacher the order which he preferred 
to read the stories. The reason for ordering the stories on the basis of pre- 
ference was because during parts of the study pupf*s could skip some stories 
if their performance surpassed a certf^in levef. If some of their more preferred 
stories appeared at th« end of a section, a pupil might want to read those 
stories and would, therefore, either hold back his efforts to avo;d skipping, 
or would be disappointed if he did skip. 

Throughout this study the students redd 500 words orally each day. The 
only exceptions to this were those instances where the last segment of the 
story was less than 5C0 words. As was explained earlier, if this segment ,vas 
less than 225 words, it was added to a 500-word segment; 1^ more than 225, that 
amount constituted the assignment fo»- thot day. 

The pral reading sessions were conducted in a small room off the main 
classroom. As the child read, it he mispronounced or was unabl^^4; o pronou nce 
a word, he was told that v/ord. During the oral reading SoSsK^^s the teacher 
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counted each correct and incorrect response. j,ncorrect responses cofisisted of 
substitutions, omissions, additions, and hesitations of longer than four sec- 
onds. Throughout the study the children were intermittently praised for fluent 
and accur*ate reading, * ' ^ 

When the oral reading session was, contpleted the student was given a sheet 
of ccmprehension questions and asked to go to h^rs desk and compie^ the assign- 



nent, - A student jould ask for help In reading the comprehension quest ions , *but 
he could not refer^tahis reader to assist Ib answering the questions. TFie / 
answers to the comprehension questions w^re checked by the teacher and .the pu- 
pil was informed which ones he had incorrectly answered. 

Data were kept pertaining to oral correct and Incorrect rates and percent- 
age of correctly answered comprehension questions. In oral reading, the data 
repc«^:ed here were from the first two minutes, not from the time requireu to 
complete the total 500-/«)rd segment. The correct and incorrect rate data were 
obtained by dividing the number of correct responses by two, and the number of 
incorrect responses by two. In order to calculate the correct percentage for 
answering comprehension questions, the number assigned was divided by the num- 
ber correctly answered; and multiplied by lOO, The pupils who ariswered quer.- 
tions from book^ one through th»-ee were assigned 30 questions each day, whereas 
the .pupils who read from books four through s'x received 20 questions daily. 

Baseline' 



This condition r.-^n for seven days. The circumstances described above pre- 
vaiKt. iJo additional feedback, instruction, or reinforcftment techniques were 
scheduled. At the end of this co.iition the 25^ imprcvenii^nt scores v;ere cal- 
culated. 



Skip and Drill ' 

Throughout tliis condition, which ran an aUraoe of 20 days, contingent 

ran^c 



skipping and drilling were arran^d. As explained earlier, if , pn th'e same day, 
a puplTs three scores were equal to or fcetter than the desired scores, he cfould 
skip the remaining, stories from a quarter of a^^book,. • 

If a pupil went seve.n days ,wl thaUt skipping, drill procedu^res were Insti- 
tuted. He received drill, h9wever, on only those aspects of reading that ff^re 
be|ow the desired scores. A student coulji receive drill on any one component, 
any two, or for all three.. The various typls of drilj were scheduled shortly 
after the readl/ig session. Drill procedures were in effect only until a pupil 

, skipped a, section/ When a pupil skipped, anotfer seven days had to e)apse be- 

/ 

fore drill was again scheduled. 
2 

B asel ine 

Skipping and drilling were not arranged throughout this condition. The 
circumstances were identical to those in effect throughout Baseline'. 



iJas^jne 



RESULTS 

1 



Tl'>w,Mjgh'^;>Chis condition the average oral correct and incorrect rates 

-J 

were 50,7 ond 3,1 v^pm. The average comprehension score v/as 65.9!^. The ranges 
of these rates were from^39-0 to 65.3 wpm, from 2.1 to 3,9 wpm, and from 55.2 
to 7B.3<^. «^ad tHi; skipping provision be^ in effect during this phase, there 
wpuld have bee.^ £:n average of .02 skips per day (total skips divided by total 
days of plipils in the condition). Table 1 is included to show the average 
oral correct and incorrect ^ates and averrige correct comprehension percentages 
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for the pupils for the thrfee conditions of the study. 



Insert Table -1 About Here 



Skip and Drill 

During this condition the average and range of the correct and incorrect 
of-al reading scores were 60,0 wpm^ (ranqe from kl .1 to 72.9 wpm) and 2.9 wpm 
(range from 1.7 to A.O wpm). When these data were compared to th^ baseline 
scares it was apparent that the correct rates for all students improved and 
the incorrect rates for four students improved. The riean correct rate improve- 
ment was 9.3 wpm (range fron^ Z.k to 15*3 wpm), and the mean incorrect rate im- 
Drovement was 2 wpm (range fn n +.5 tfi -.9 wpm). 

Meanwhile, the average comprehens ion >core during this phaije was 77»8% 
(range from 63-^ to 8^.9^)- Ti.e comprehension scores of all the pupils improved 
throughout this condition. ^The average improvement was 11.9% \ran9e from^ 5-7 to 

Throughout this condition 33 skips were made, an average of^.24 per day. 
The students Spent an average of ^.7 days per section before skipping (rang? 
Trom 2.2 to 12); k2 % of the skips occurred on the first-day of a sectiocK On 
the average, when drill was instituted, 2.6 days elapsed before a pupil skipped. 

Baseline 

When- the skip and drill intervention wa&t removed, the ^performance of the 
pupils gener^My maintained. In some^insfances performance actually improved. 
^ Throughout this condition the^verage oral correct rate v as 62.2 wpr^ with 
a range of 5^»3 to 79»3 wpm. The cveragc incorrect ratey<«nd range were 2.7 wpm, 
from 2.1 to 3-3 wpm. When these data were compared to the intervention pha:e, 
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it^ was apparent thatithe correct r^es of four students improved and the incor- 
rect rates of four students Improved ♦ - ' . 

The average comprehension percentage and range scores during this phase 
wfre 80.2%, from 7) .0 to" 89. 7^- V/hen these data were compared to those of, the 
preceding phase, Ft was noted that five students Improved. ^Had "the skipping 

provision been in ef/ect during this condition the numUer of skips per day would 

^ ^ " V ^ - . 

have been .16. • 

.Figure 1 i's Included to sh'ow the dally oral reading and tomprehens ion" data 



from one pupil. . All three aspects of this 'pupil's performance were influenced 



4 

by the skipping and drilling interventi-ons. 



Insert Figure 1 About He/e 



Discussion 

The data Indicated that the intervention — skipping and drilling — was ^f fee- * 
tive for all the pupils in this study. From these data, however, we were unable 
to determine i/hether skipping or. drilling, or the combinatlorj of the techniques, 
waSi responsiHle for the'galns. 

There is some possibility that the drill procedure alone could have been 
largely responsible for the improvements. Although our drill procedures were 
neither nev/ nor different, they v/ere related directly to specific reading prob- 
lems and were contingently arranged. If, after seven days, for example, a pu- 
piPs correct rate was not fast enough, fie received a correct rate drill. Simi- 
larly, if his oral incorrect rates were too high or bis comprehension percentages 
were too low, he received drill for those features. It has been our experience 
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that when .simple Instructional techniques are designed for specific problems and 
contingently. arranged, improvement Is Immediate and significant* 

Another possible explanation for the improvement of some pupiU could be 
the threat of drill. For some students, drill could have been perceived as a ^ 
punishing event, hence they sought to avoid it. - 

It is also possible that the improvement of the pupils was due mostly to 
the skipping feature. The pupils in this study were, at the beginning of the 
year, reading from one to three years below grade level. All of them knew the 
level at which they were assigned and the levef at which. they should be reading 
(in spite o^' the coding systems used by various reading series). They_also knew 
that most of their friends were reading from more advanced books than they were. 
It is quit^ possible, then, that being able to skip through books and approach 
or reach grade level was very reinforcing for these boys. 

During the next two academic quarters we conducted studies designed to sort 
out some of the specific effects of skipping and drilling. In the winter quar- 
ter we formed three "groups*' of subjects. Following a baseline phase: three 
students were assigned to a skip-and-dr i 1 1 condition, just like the one in the 
experiment just described. Meanwhile, two students, following a baseline, were 
placed in a drill-only condition; and two other students were placed In a skip- 
only condition. 

When these results were analyzed in regard to correct rate, it was revealed 
that the skip-and-dri 1 1 and the skip-only groups gained more than the drill-only 
group. Both groups gained, on the average, 7.0 wpm. When incorrect rate im- 
provement v;as studied, the skip-and-dri 1 1 and skip-only groups faired the best. 
Average incorrect rates for both groups were lowered .1 wpm. When comprehension 
improvement was analyzed, the drill-only group showed the fnost improvement. The 
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average gain for that group wa- 3,6^ 
- During the spring quarter, two students who had been in the skip-and-drl 11 

concjition during tlie winter quarter, continued fn this condition* When these 

\ 

students* performances at the end of the spring quarter were comparecj to their 
efforts during the winter quarter, it was found\^at both their correct rates 
increased (2.9 and 3.9 wpm)^ "T^ie Incorrect rate of'^one boy increased\;l wpm) , 
while for the other it decreased {•6 wpm). Both boys^'^comprehension scores in- 
creased (10.6 and K2^). \^ 

Although we ran these two additional studies we wereX still unable to make 

■ \ . ^ 

definitive statements as to the relative merits of the two procedures since too 
few subjects were involved. However, the opportunity to skip, of itself, did 
appear to be reinforcing. In the major study we described, the drill procedures 
were never used for some students. In fact, 70% of all skips occurred -wi thout 
the necessity of drilling. 

Throughout the year every student improved in every respect. The average 
^ . correct rate gain was 32.9 wpm from beginning to end of the year. The average 

incorrect rate improvement was J. 3 wpm; and the average percentage comprehension 

♦ score gain was In addition, all the pupils were reading at grade level at 
^ the end of the year. They had, throughout the year, gained an average of 1.9 

grade levels (range from 1.0 to 2.5)* Furthermore, the students attained grade 
level in an average of 15.7 weeks. Teachers of reading should be encouraged by 
the fact that in spite of the short amount of time devoted to reading (average 
/ 25 minutes per student per day), all the s :udents improved. 

This procedure for teaching reading has several ottier features which should 
be considered by teachers. First, the idea of having pupils read about 500 words 

• each day and answer several comprehension questions should be considered. By so 

ER?C ■ 
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doing, the teacher can measure progress in two important elements of reading. 

A second matter for teachers to consider pertains to the interventions that 
were used. Irj this study, neither expensive nor time-consuming aching tech- 
niques- or reinforcement systems were used. The drill procedures were very common; 
teachers have used those same techniques fdr years. The manner in which the 
drill procedures were used In this study was, however, somewhat unique. Drill 
was not scheduled every day, it was arranged only If a pupiPs performance fell 
below a certain level. 

'As to the reinforcement technique, only a skipping provision was arranged. 
The teacher did not resort to an elaborate motivational system such as a token 
economy that could have required additional costs or personnel. 

A third, and perhaps the most important feature of this study for teachers 
to consider was the manner in which pupils were advanced from one part of a book 
to another. In this study a student skipped from one quarter of a book to an- 
other only if his oral reading and comprehension scores were adequate. This 
same approach could be used for advancing pupils from one story to the next (if 
skipping is not desired), or from one reader to another. The significance of 
the Approach Is that advancement from one level to another is based on pupil 
performance, not on time, or that others In the group have passed, or other 
•rrelevant factors. The method for advancement described here and the method 
used for placing students that was referred to should be seriously considered 

by teachers who want to individualize reading i struction, 

\ 
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FIGURE CAPTIONS 



Figure 1. The top graph shov/s the ^aily correct and Incorrect oral reading 
rates for HF throughout the three phases of the study. The bottom graph 
shows his daily comprehension scores. The average rates and scores for 
the three conditions are included. The reason some data plots are not 
connc-*ed is that data were not obtainea on some days (weekends, absences, 
field trips). 



^ ... . 
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Table 1 
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X Correct wpm, Incorrev^t wpm & % Comprehension 
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c/e 


^5.2/3.9 


59.7/3.0 


58.0/3.3 




% 


.63.'* 




79.7 
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c/e 


;):^.3/3.9 


61.7/^.0 


65.8/2.9 




% 


55.2 


63. A 


7^.5 
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65.8/2.3 


72.9/2,^ 


\ 79.8/2.8 




% 




79.2 


71 .0 


DP 


c/e 


9/2.1 


60.2/1.7 


59.1/2.1 




% 


71. i« 


8i».3 


86. 


MS 


c/e 


39.0/3.8 


^♦7.7/3.1 


5'».3/2.7 




% 


78.3 


8'«.0 


89.7 


TS 


c/e 




58.8/3.3 


58.1/2.9 






59.5 


7'».0 


76.0 


BW 


c/e 




58.8/2.3 


<. 60.6/2.1 






68.8 


8/».9 


8A.0 




c/e 


50.7/M 


60.0/2.9 


(31.1/2.1 






. 65.9 , 


77.8 


80.2 



V 



100- 



base 
45.2 



5 I OH 



3.9 



^ 0 



READING SKIP 
Skip E F Base 



59.7 



3.0 



58.0 



3.3 



Advisor- Lovitt"^ 
Manager-Hansen 
Behaver-MF 



Successive calendar days 
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The Differential Effects of Reinforcement Contingencies on 
Computational Arithmetic Performance 
by 

Deborah Deutsch-Smith'-and Thomas C. Lovitt 
Abstract 



The experimenters conducting this research investigated the differen- 
tial effects of reinforcement contingencies in two different computational 
arithmetic situations — acquisition and proficiency. Seven, eight to eleven 
year old boys, participated as subjects. 

Two experiments comprised the research. In Experiment I, the 
boys were presented with arithmetic problems which they could not 
compute accurately. Their baseline scores were all 0%. Contingent 
toy models were used unsuccessfully as the first intervention; their 
scores remained 0%. 

In Experiment II, two types of reinforcement contingencies were 
applied--contingent-freetime and cpntingent-toy-models. During this 
experiment the boys' computational speed or proficiency needed improve- 
ment; in this instance the reinforcement contingencies were influential. 
The median improvement in their correct rate scores was 19% for both 
interventions . 

This research demonstrates the importance of careful diagnosis 
of children's academic deficiencies. Once children's specific educational 
levels are determined, interventions must be selected which aim at specific 
types of performance. It is possibL' that many arithmetic interventions 
are effective with only certain types of performance. For example, in 
this research although reinfor^^rn^nt contingencies increased the children's 
computational proficiency, they were not effective in the acquisition 
situation. 



The Differential Effects of Reinforcement Cwntingancies 
on Computational Arithmetic Performance^ 

by 

Deborah Deutsch Smiih and Thomas C. Lovitt 
Experimental Education Unit 
Child Development and Mental Retardation Center 
University of Washir^gton 



Reinforcement contingencies vere introduced to classroom settings 
over 10 years ago (Staats, Staats, Schutz & Wplf , 1962; and Zimmerman 
& Zimmerman, 1962). Through the years these procedures have beer, 
refined for application with a variety of classroom actrvities. The use 
and frequent overuse of reinforcement coi. 'ingencies 'las been well documented 
(Axclrod, 1971; Kazdin & Bootzin, 1972; Lipe^&Jung, 1^71) O'Leary 
& Drabraan, ^9^1; and Stainback, Payne, Stainback & Pa/ne, 1973). 
Although reinforcement contingencies have been applied to many diifei*ent 
situations, little academic research has been conducted to verify the 
general use of those procedures for academic subjects like arithmetic, 
spelling, and reading. Occasionally, one hears ardent claims *.hat if 
teachers use reinforcement contingencies all ^educational problems will 
be solved; undesirable behavioi s will dis^^ppear and knowle^lge of 
acauemic subject matters will increap^ at record pac<=*s. Since some 
teachers have an affinity for applying contingencies, it is important 
to determine whether those procedures are appropriate in all teaching 
situations. 

Research conducted in nonacademic areas indicales that reinforcement 
contingencies are not always influentiah Ayllon and Azrin (1964), for 
instance, found that when mental patients' initial performance level 
of picking up appropriate eating utensils v^.s nearly 0%, the application 
of reinforcement ontingencies was not effective. When instru'ttions 
were added th'*' aesired behavior increased immediately. Reinforcement 
contingencies were then used successfully to maintain the patients' 
ability to pic^ up the r propriate cutlery and eat in a socially acceptable 
Manner. Apparently the initial reinforcement contingencies vere not 
effective because the desired behavior did not occur and therefore could 
net be reinforced* 

-f 

,^ 

In another study. Hop V ins (1968) founu reinforcement contingencies 
to be initially ineffective. In :his case, an institutionalized boy did not 



-^This research was supported in part by a National L.stitufe oi R^^earc^ 
grai't. (Grant #OEG-0'-70-3916 [607], Project #572247) 1 % ' 



smile. Wh'.n candy reLuorcement was initially scheduled, his smiling 
did nut increase. Instructions hadV be employi i to increase the boy's 
smiling above a zero level. Since the desired behavior was not in his 
iepertoire at the beginning of the stud; , the reinforcement did not alter 
his behavior, Once he acquired the behavior, however, the frequence 
of the boy's sniiling was effectively increased when t^e candy reinforcement 
was rescheduled. 

In both of these studies reinforcement contingencies were not 
initially influential because the desired behaviors ware not in the reper-* 
toires of the subjects. In both cases, the desired behaviors had to be 
acquired before reinforcemf*nt contingen^^ies were effective. Reinforcement 
contingencies nerved to increase and maintain satisfactory le/els of 
.erformance. 

Wh*..n teaching academic subjects, a comparable instance occui s. 
In fact, classroom teachers e fnced with three distinctly different 
situations: quisition, proficiency and ma!::tenance. TLe acquisition 
sH.uation occurs when the desired behavior is not in the repertoire of 
the child; the child does not know how to perform the desired task. 
For instance, he cannot correctly solve a :ype of arithmetic problem. 
In the proficiency situation, the individual posses ;es the ability io accurately 
complete the task, but is unsure of the process and, therefore, is too 
slow at performing the task. In this case, a chile* 'a percentage scores 
indicate that he knows the substracf n facts, but liis correct rate scores 
indicate that he does not know the luotraction facts well enough to solve 
them quickly. Once a child has acquired a nevv skill and has \ come 
proficient in his performance of that skill, the teacher mus* insure that 
the student maintains this lev of proficiency. 

The purpose of this research was to determine whether reinfcrce- 
ment contingencies are cffecti\e in V^'i of these three academic situations — 
acquisition and proficiency. Two experiments were conducted. In tie 
first, reinforcement contingencies were scheduled when th< ^hildrtn 
needed to acquire computational arithmet.- skills. In the second experiment, 
reinforcement contingencies were applied when the children's computational 
proficiency needed improvement. Although the inte'^'ventions Msed la 
the second experiment aimed at increasing prciiCienQy, a maintenance 
condition was conducted to determine whether the children retained 
their improved performance- levels. 
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52I?£r al M<, ».h odolo^y 

In compuiational arithmetic there are many different types of pro- 
blems; each requires the abilit"/ to use a slightly different set of rul«.s» 
Before a child can become proficient at a computa* >nal task he must know 
the process involved in solv ng specific types of arithm^^tic prob'^ms. 
Merely memorizing tn*^ acdition facts, for example, does not guarantee the 
correct solution to all problems whi .h require addition. There are some 
general process rules (such ^ 5 ca*x-ying) which must be followed to solve 
all the vaiiations of addition problems. 

If childr compute arithmetic problems too slowly, they do not 
complete their work os fast as their classmates. As arithmetic assignments 
become more complex, thtss children often work even slower and complete 
« fewer problems* Frequently the reason for thes^e children's computationa 

difficu''/ is their lack of proiiciency in usinj^ the basic facts which are 
^he rudiments of larger problems. 

In the first experiment the children were presented with arithmetic 
problems which required ^)rocess rule sue** as borrowing or cari-ying. 
They coald not aicurately compute these problems. In that case ths children 
needed to acquire new arithmetic skills In the second experiment, 
the children were presented with aritiimetic-fact problems which they 
could compute accurately, .)ut the/ did'so too slowly. In both experiments 
reinforcement contingencies were used as the interventions. - 

Subje cts 

Seven learning disabled boys, who ranged in age from eight to 
eleven years participated m this research. Three of the boys were 
involved in Experiment all the boys participated in Experiment II. 
They were referred from one local school district to the Experjimental 
Education Unit (EEU) for one academic year because of general academic 
deficiencies. 

Setting 

This research was conducted in the Research Classroom at the 
EEU of the Child Development and \ iental Retardation. Center ^t the University 
of Washington, The primary purpose of this classroom is the investigation 
of the efficacy of various curricular materiais and teaching techniques. ^ 
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Reliability 

Reliability measures were obtained on timings, procedures, scoring, 
and graphing the data. Reliability scores were better than 99% on all 
measures. 

Material Constructio n 

*\ 

Twc types of drithmet.a problems v^ere selected for each child. 
Experiment I included problems which the child needed to *^arn how 
to compute. In order for those problems to be included in ine experin*ant, 
the child had to score 0% on the problems for three cc*isecutive school 
days • 

Problems ured in Experiment II were those ^'hich the child knew 
how CO compute, but was not proi.\zient m arri'ang at the solutions. 
The criterion for selecting these problems was that t*\e child's correct 
rate not exceed that of two-thirds of his peer group attending? public 
school. Those rates were obtained by, the juthors before this research 
was conducted* 

Once specific arithmetic problems were selected for eacn child, 
daily arithmetic pages were constructed . The procedures foi constructing 
the pages were constant regardless of the problem type use If, for 
example, in Experiment I a child needed to learn to solve subtraction 
problems which required borrowing fron. a zero in the units column 
/ 890- 

\z12Zj * cnly problems of that type were used for his daily arithmetic 
sheets. Through the use of a table of random numbers, five a^'ithmetic 
pag,es\were constructed for each problem type. No problem was usci 
more than once. The child received a di^'-jrent version of his arithnictic 
pages each day of the week. 

In Experiment II, arithmetic-fact problems v/ere used. Since the 
number of fact problems available is smaller t^ian that available for more 
complex arithmetic problemis the format for constructing tnese arithmetic 
pages varied slighdy. For irtstance, if addition-fact problems which 
have one digit in both addends and two digits in the sum were used 
/' 9 I ■ 

> all problems of that type were identified. A table of random 
numbers was used to arrange the problems on the arithmetic she^t^ 
Five diii^jcmt sheets were constructed for these problems. Since ^\ 
there f ^ \ only 45 problems in this class, all problems were used more 
than once. 
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Design 



Every study in both experiments followed an ABA design. Criteria 
for change ox condition, h<^wever, differed for the .wo experiments. 
In Experiment I, the Baseline Condition lasted three days; all the scores 
during that condition had to be 0%. Th^ intervention condition lasted 
at least seven data days and was to be concluded when the last three 
scores for that'condition were 100%. The intention was to follow with 
a Maintenance Condition. That condition v/as also to run at least seven 
data days and to be concluded when the last three scores were iOO%. 

During Experiment II the children's correct rates, rather than 
percent correct scores, were used as the basis for changing conditions. 
Each condition during these studies ran at least seven data days and 
wa'^ concluded when the last four scores were either decelerating or 
accelerating at a median slope not greater than XI. 2.^ 

Gen?^ral Procedures 

Each day the children were required to work on a set of arithmetic 
pages. They rec»nved a different varirtion of ^.he pages each day of 
the week. The children were allowed to work on the Experimen* I page 
for two minutes and the Experiment II page for one minute. After the 
children put their names and the date at the top of the pagen, the experimenter 
said, "Ready, start working." At the end of the allotted time, the experimenter 
said, "Pencils down." No other iriL^tructions were given. No feedback 
was provided the children regarding their performance during any of 
the research. 

After the children computed the problems for the allotted time, 
the experimenter collected the sheets. She then corrected the pages, 
calculated percentage and correct and error rate scores, entered these 
on data sheets, and plotted the data. Partially completed and skipped 
pi Dblems were not counted as either correct or incorrect. 



A median slope w'as calculated through thoh^ data points. It was 
obtained by calculating a line which allowed lor the least amount of 
variance by using the unsigned medians. The median slope iriicates 
the trend of the data. Scores indicating that a child's rates werp becoming 
faster are prefaced by an "X"; if the child's rates were becoming slower, 
the median slope score is prefaced by a "-r- " . 
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Experiment I 

Three studies were conducted during this experiment. In each, 
the students needed to acquire new computational^^arithmetic skills. 

P rocedures 

Kyle, Brett, and Stephan participated in this experiment. Kyle 
was assigned three-digit multiplication problems which did not require 
^231) 

carrying \ xl32 ' . Brett computed subtraction problems which required 

560 ^ 

borrowing from a zero in the units column y -SZ? /. Stephan solved 
multiplication problems which required carrying. Those problems had 



one digit in the multiplier and two digits in the multiplicand 



CD 



Baseline . No instructions, feedback, or reinforcement contingencies 
were in effect dqring this condition. 

Contingent toy . On the first day of this condition, before a child 
was given his arithmetic pages, he was allowed to choose a toy model 
from a large selection. After the boy made his choice, the experimenter 
wrote the child^s name and the cost of th*.. model (10 points) on an index 
card which was adhered to the model. He was able to purchase the toy 
model with points earned during arithmetic time. 

Before the^child received his arithmetic page for the-^day, the 
experimenter wrote "1: 1" on the top of his page. The experimenter then 
explained the ratio to him. She said, ^*For every problem you do correctly 
you will eaW one point towards the model. " The experimenter predicted 
that the child would compute no more than five problems correctly each 
day. The ratio, therefore, was^established for the child to earn a modjsl 
every two days. 

After the child worked on the problems the experimenter collected 
the pages, corrected them, and reduced the cost of the model by the 
number of points the child had earned. Since none of the children solved 
any problems correctly during this condition, they earned no points 
and the cost of their models remained at ten points throiighout the phase. 

Demonstration . This condition was included in the experiment 
since the boys did not master the problem types presented to them when 
the contingency was in effect. During this condition, before the child 
received his daily arithmetic pages, the experimenter wrote a sample 
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problem on an index card. Before the child computed his problems 
for that day, the experimenter went to the child's desk and demonstrated 
thet appropriate process to follow as she worked /xhe sample problem. 
After solving the problem, the experimenter lefttthe child's desk and 
took the sample problem with her so the child did not have it to refer 
to as he computed the problems by himself. 

Maintenance . It was originally planned for this condition to follow 
the Contingent-toy Condition, An additional intervention was required, 
however, for the children to master the problems presented to them. 
When the Maintenance Condition was scheduled, no instructions, feed- 
back or contingencies were in effect , 

Results 

Since n^ne of the children improved their computational performance 
when the conftngent-toy tactic was in effect, another intervention was 
schedul^dr Steplian's data were selected for display because they are 
representative of the other children (Figure 1) , Tabl6 1 summarizes 
the results from all the children who participated in this experiment. 



Insert Figure 1 and Table 1 About Here 



Baseline . All the boys scored 0% for the three days of this con- 
dition. 

Contingent toy. This condition lasted seven days for each child. 
All of their percentage scores were zero while this intervention -was 
in effect. 

Demonstration , Each boy received a median score of 100% while 
the Demonstration Condition was scheduled. 

Maintenance , During this condition baseline conditions were 
reinstitutfed. All the boys maintained their high level of performance 
and received median scores of 100% for this condition* 

Discussion 

During the Baseline Condition, the boys demonstrated they could 
not accurately compute the problems presented to Ihem. When the Contin- 
gent-toy Condition was in effect, none of the boys improved their computa- 
tional performance. Because the required computational performance 



was not within their repertoires, as indicated by their initial percentage 
scores of zerb, they did not receive reinforcement. Reinforcement, 
by definition, increases the probability of a behavior occurring, but 
the behavior must occur before it can be reinforced. 

Reinforcement contingencies, when used alone, will not positively 
alter behavior which must be acquired. Ayllon and Azrin (1964) and 
Hopkins (1968) arrived at similar conclusions when they unsuccessfully 
applied reinforcement contingencies to social behaviors which needed 
to be acquired. 

The data from this experiment indicated that reinforcement contingen 
cies are not appropriate to all teaching situations. Evidently, when 
new skills need to be acquired, interventions other than reinforcement 
contingencies should be scheduled. 

Experiment II 

During this experiment, children's computational proficiency 
rather than accuracy was the target. They had mastered certain computa- 
tional skills, but needed to become proficient in performing these skills. 
Two types of reinforcement contingencies were used to increase the 
boys' computational speed on arithmetic-fact problems. The order of 
the interventions was the same for all the children. The first intervention 
was contingent-freetime . During this condition, the cfhildren earned 
points which were redeemable for time to spend in preferred activities. 
The second intervention was contingent-toy-models. Once again the 
children earned points for their computational arithmetic assignments, 
but now these points led to the purchase of toy models. 

Pj^ocedures 

During the experiment six boys computed addition-carry facts 
and one boy subtraction facts! Addition-carry facts are those pi^oblems 
which have single digits m both addends and two digits in the sum 
ft " 

^ '♦'8 , Subtraction facts are those problems which have single digits 

( 

in the minuend, the subtrahend, and the remainder V -2 / . 

The same procedures were used with all the children. After the 
Baseline Condition, the contingent-freetime intervention was scheduled, 
followed by the contingent-toy intervention. The studies were concluded 
with a return-to-baseline phase. 



Baseline , No instructions, feedback* or reinforcement contingencies 
were in effect . ' ^ 



Contingent freetime . While this condition, was scheduled, the 
children earned freetime to spend as they desired. The amount of freetime 
earned was directly related to the number of correct problems they com - 
puted each day. 

A ratio — correct problems to amount ot freetime earned — was deter- 
mined for each child before the condition was ini^ated. This ratio was 
established by calculating the median correcf rate score for the Baseline 
Condition. This score was then divided by five — the amount of time 
a child would earn if his daily correct rate score during this condition 
equaled his correct rate median for the prior condition. The answ<it 
indicated the number of problems the child had to solve correctly to 
earn one minute of freetime. For example, if\a child obtained a correct 
rate median of 10 problems during the Baseline Condition, 10 was divided 
by five. For every two problems the child computed correctly, he earned 
one minute of freetime. If this child solved 14 problems accurately, 
he earned seven minutes of freetime, . ' 

Daily, before a child received his arithmetic .^age, the experimenter 
wrote the ratio on the top of the child's page. Before the child computed 
the page, the experimenter came to his desk and explained the ratio 
to him. The only statement made to the child was, "For every two problems 
you do correctly you will earn dne minute of freetime. " No other instructions 
were given the child. 

After a child worked on his assigned problems for one fhinute, 
he was told to stop working. The experimenter then came to his desk 
and collected his page of problems. After she corrected the problems 
and calculated the amount of freetime he had earned, the experimenter 
told the child how much time he was entitled to spend. That amount 
of time wus also noted on a piece of paper which was posted in the front 
of the classroom. This was done to insure that the child spent only the 
amount of time he had earned. No praise was given the child for his 
performance. 

Various activities were available for freetime. Some children worked 
on. shop projects; others put puzzles together. Many different activities 
were chosen by the children as freetime activity. The children were 
permitted to spend their freetime when thef desired, as long as it was 
not saved for more than a two-day period* 
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Contingent toy. When this intervention was scheduled, the children 0 
earned points which eventually led to the purchase of toy models. BSfore 
this condition began , the experimenter determined the ratio for points 
to number of correct problems by using the formula from the Contingent- 
fre^tirae Condition. The toy models were priced for each child in this 
way: the median of the Contingent-freetime Condition was divided by. 
the ratio multiplied by six. If in the previous condition a child obtained 
a correct rate median of 14 and the ratio used in that condition was 2: 1, 
two was divided into 14. The answer, seven, was then multiplied by 
six. 'The cost of this boy's model was 42. The division step in this^ ^ 
formula indicated the average number of points the child earned each 
day during the Contingent-freetime Condition. If he retained his level 
of performance, the child earned his toy model in a reasonable length 
of time: six days. If he became faster in his computations, he earned 
his toy sooner . 

On the first day of this condition, the child was allowed to select 
the toy model he wanted to purchase. Once he did, his name and the 
cost of the model was written on an index card and adhered to the model . 

Each day., the child's ratio was written on the top of his arithmetic 
page^ Before inc child worked his page, the experimenter came to his 
desk and explained the ratio to him; no other instructions or feedback 
were provided the child. After the child worked the problems on that 
page for one minute, the experimenter collected the page, scored it. 
atxd calculated the number of points the child earned. She then went 
to the toy model and decreased the cost by the number of points the child 
earned. Once a child earned enough points to purchase his model, it 
was given to him and he selected another model to work for. 

Return to baseline . Baseline procedures wer^ reinstituted. 
No instructions, feedback, or reinforcement contingencies were scheduled. 

Results 

For this experiment medians, median slopes, and percent-of change 
scores were calculated for each child's correct and error rates for each 
condition. Median slope scores were calculated to determine whether 
a child v/as becoming fainter or slower in his computations within a condition. 
The percent-of-change store was calculated to show the amount of change 
from one condition to the next. This indicated median to median change*^ . 
The following formula was used to obta'n this sco^e: 

Mdj-Mdi * 

x 100 =2 percent-of-change s^ore. 

Mdj 
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For example, if the baseline rn..Jian was TO and the median correct rate 
score for the next condition was 15, the difference between these two 
scores was five. The baseline .nedian was then civided into five. The 
percent-of-change score m this instancf^ is 50%» 

The data from one Brett, were, selected to display (Figure 

2). His data were representative of the other children. A summary- 
table is also included which indicates the correct and error median rates, 
slopes, and percent -of-change score of the seven children. 



Insert Figure 2 and Table 2 about here 



Baseline . The correc* rate middle median for the seven chUdren 
during this condition was 21 . 0 (range from 9. 0 to 33. , The er*ror 
rate middle median was 0 0 (range from 2.0 to 0.0). Jrett's median 
correct rate was 15.0; his error rate median was 0.0. 

•> 

Contin^:ent freetime . The correct rate middle median for the children 
was 21.0 (rangf. from 13.0 to 36. 0) and the error rat*-^ middle median 
for all was 0 0. The median level of improvement for all the children 
was 19% (range from 0% to 52%) . 

Brett obc^ined - correct rat*^ median of 19.0 and an error rate 
median of 0.0. The amount of change ^rom the Baseline-Condition tc 
this condition was indi-^ated by the perccnt-of-change score, -^27%, 

Contin^^ent toy . The median improvement n'^ted for the boy'5\correct 
rate medians was 19% (range from 0% to 21%) . The correct rato middle 
median was 26.0 (range from 16.0 to 39.0) . The error rate middJe median 
was 0. 0 (range from 3 . 0 to 0 ♦ 0) . ^ 

Brett's correct r^ate median was 23.0; Ms error rat ^ median was 
0.0. His correct percent-of-change score was +21%. 

Return-to-baseli n-^ . When the reinforcement coritingeA.cies v^ere 
withdrawn, all of the children'^ correct rate meUians decreased. The 
median child lost 9% of his correct rate (range from -6% to -25%) . The 
correct rate middle n^dian for the oCven children v,^s 23.0 (range from 
12,0 to 36.0). The middle median error zate was 0.0 (range from 3 0 
to 0.0). 

i 

Brett^s co^-ect rate median was 18.0. H' en or rate median wis 
0.0. Brett's correct rate piedian Score dccrrased during this condition 
by the a nount it increased in the prior condrion, Z\%\ 



iSscussion 



When the children had the opportunity to earn freeame for their 
arithmetic assignments, and the contingencies were aimed at increasing 
com^ utationai speed, most of the children's correct rate medians increased. 
One child s correct rate median score did not njcrease; it remained at 
the level of the baseline, phase » 

When the contingent-toy intervention was ? iheduled, all but one 
child showed increases in their correct rate medians. The median level 
of ur^provement was again 19%. 

When baseline procedures were reinstituted, all of the childrei^^s 
correct rate median^: decreased. however, concluded this exp^eriment' 

with a higher -correct rate medi^tn their initial levels. No appreciable 
rises in error rates were noted dmi\<g this experimer.;.. Although the 
children ^5 cdrrWt rzsies imprc ed, nu*^ ^ obtained correct rates which* 
indicated that they had become proficient in computing the problems 
presented to them. 

Geneially, both reinforcement contingencies were influential 
and stimulated increases in the children's correct r^te scores. Each 
intervention brought the children's performances closer to the aim of 
5C correct problems per mmute. The interveations, however, did npt 
produce identical results. Therefore, a comparison was made between 
the two reinforcement contingencies. The contingont-freetime tactic 
fared slightly better than the contingent-toy intervenrion: Although 
the median percent-of-change scores for both intervention conditions 
were equal , a wider range of those scores was noted when the Contingent- 
freetimo Condition was in effect. The percent-of-change sccres ranged 
from 0% to 52% while the contingent-freetime intervention was scheduled, 
and 0% to 21% for the contingent-toy intt rvention , Several children made 
greater gains when the contingent-freetime intervention was in effect. 

There was one other advantage in using the freetime tactic. Although 
the boy's error rates were not considerable, no child had an error rate 
median score above 0.0 during the Contingent-freetime Condition. 
Severa* children had initial medians above 0.0, and sor-.e obtained higher 
error rate scores during the Contingent -toy Condition. 
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Discussion 

Two different educational situations were studied in this research — 
acquisition and proficiency. In the acquisition situation the children 
did not know how to accurately solve various types of arithmetic problems. 
They did not know the appropriate computational rules required for 
solving the problems correctly. In the proficiency situation, the chiloren 
knew how to solve the problems accurately, but they did so at a slow 
pace which might have impeded.thf .r future progress in computational 
arithmetic • 

Reinforcement contingent .es were applied in both academic situations. 
The results indicated that reinforcem'^nt contingencies 'vill alter children's 
con^putational nroficiency, but not a; uisition. The major emphasis 
of tills re^ earch was to demonstrate that some intervenlions are indigenous 
to certain eJ .:aMonal r tuations and, the: by, are effective on*y in specific 
circumstances. 

For teache' s to seiect the appropriate interveations for thei>* stuaents, 
they mus first determine each student s educational level,. . In c omputational 
arithmetic .t is imperati/e that teachers identify the specific types of 
arithmetic problems th-^lr students cannot compute accura- - ly . It is 
also important for them to determine which problem types their students 
ar _ not >f t proficient ir .^olving. After this diagnostic process is conducted, 
teachers .nust then dec ' . which ints^rven* strategies they will employ 
to remediate their students' computationa.; deficits. 

This research indicated that at least one type of intervention strategy 
is not appropriate in a;.l types i educational situations . Reinforcement 
contingencies were not effective when children needed to acquire new 
computational skills. Tn that ca«e, an instructional tactic brought the 
children to mastery \ev^^ of perturm , ice. ^Vhen diildren s computational 
proficiency needed imp. /ement, reinfo ^ent contingencies influenced 
their computaf* mal speed. It is probable that other intervention strategies 
also have differential effects depending on the specific 1 pe of educational 
situation in which they are apphed. It could be that there are varying 
levels of acquisition and proficiency which also influence the strength 
of the intervention strategies scheduled. Such information will only 
be discovered if educators clearly diagnose the educational situatioiis 
before teaching tactics are implemented. 
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rlGTjRE CAPTIONS 



Petcent correct for Stephan's prob. ems assigned for Experiment I. 
Oa!y successive school days are coinect< d by lines. Solid 
vei<ical lines indicate change of cond^'ion. 

Correct and error rate data for Bret\'s proIJems during Experi - 
me it II. Dots indicate correct rate s :ores end triangles 
represent orror rate scores. 
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THE INFLUENCE OF HISTRUCT I ONS AND RE 1 .^^FORCTKEM 
CONTINGENCIES Or; CHriDREN'S ABIIJTIE.S TO 
COMPUTE ARITHMETIC PROBLEHS * 
by Deborah Deutsch Smi th 
and 

5^ Thomas Cl Lovi tt 

r 

^b•i tract ''^^ V 

This research Investigated th' ae different methods co incrcasii computa- 
riona: spued (prof ic icncy) Instruct ions , reinforcement cont inq^ncies and a 
vv>mb:n<ition of the tw Th^s subjx:.cts v/ere ^even boys, 3 to II yuars old. 

This rosearch involved th-ee parts. In the first part, the influence of 
instructions was investigated. Aftci the baseline period, thj children were 
told to ''qo faster" before the/ computed the problems. The median improvement 
in correct rate for the seven t jy^ was lk%. 

In the ? cond part the inter s^cnt ions were two types of rei nforccrnent 
conti'ngencies . Afi.er a baseline period, cont i ngent^'f rect irr,e was initially 
schedule . The median increc^se in correct rates was \^)%. Wext , a contingent- 
toy v/as scheduled; the children earned points towards the purchase of toy- 
models. The medi^^n increase in correct rates during this condition wf- . \^X. 

In the third part, the instructions used in Pc-rt I were pciired witn the 
contingent-toy used in Part 11. The median increase was kk%., Tht^ pairing of 
instrjctions with re in'^orcem. it contingencies influenced the /jreotos^t median 
Improvement \\\ the bey's computational speed. 



\ 



THE If-'FLUENCE OF INSTRUCTIONS AND f^E L'lFORCclE. iT 
CONTINGENCIES ON CHILDREN'S ABILITIEb TO 
COMPUTE ARITHMETIC PROBLf-MS' 

\ 

oy . 

Deborah Deutsch Smith and Thomas C. Lov'tt 
Experimenta] Education Unit 
( Child Development and Mental Retardation Cento** 

University of Washington 

Since 1962, reinforcement contingencies hev^, been systerncticaHy used 
in classroom settings (Starts, Staats. Schutz & Wolf, 1962; Zimmerman & 
Zimmerman, 1962). Often, when reinforcement contingencies were applied 
additional interventions were paired with the reirforcers. In programs 
utilizing reinforcement jcontinqencies , the individual, is frequently given 
instructions regarding the desired behovior. After tL inJividual performs 
the desired behavior he is rewarded. » 

This practice of combining Fntervention tactics in a research setting 
can confound the results and seriously limit the implications drawa from the 
research. Kazdin (1973) stressed the dangers of this practice. 

Studies in this area [applied behavior analysis (authors* addition)] 
have usually confounded Instructions with contingent reinforcement. 
Typically, subjects are Instructed as to what behaviors earn tokens 
and are reinforced accordingly. It may be that the behavior changes 
are due to instructions, reinforcement or their combination, [p, 63] 

Reinforcement contingencies have positively altered children's computa- 
tional arithmetic performance. Chadwick and Day (1970 studred'^the effec-""^ 
tiveness of a token system on three measures: percent of time at work, 
problems completed per minute and correct percentage scores*. This research 
Indicated that all three measures increased as a result of reinforcement 
procedures. 

Kirby and Shields (1972) and Ferritor, Buckholdl, HamLlin and Smith 
(1972) also demonstrated that reinforcement contingencies:? influenced arith- 
metic performance. In both studies, when points were arrt:nged contingent ^ 
on accurate reisponding, that aspect of performance w£iS positively altered. 



Mhis research was supported in part by o Nationol Institute of Education 
grant. (Grant //OEG-0-70-391 6 (607), Project #5722^7) 
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As part of a dissertation, one of the authors of thi 5 'research , Smith (1973), 
investigated the effects of reinforcement contingencies in an acquisition 
situation. Dur'hg a baseline condition the pupils were asked to solve arithmetic 
problems. Their scores in this conditipn were invariably zero. Following 
this baseline, reinforcement contingencies in the form of points for freetime 
vvere 'Scheduled. The Contingencies were ineffective in all cases. 

In a study not concerned with arithmetic computation, Hopkins (I960) 
also scheduled reinforcement contingencies in an acquisition situation. 
In an effort to increase a child»s smiling, reinforcement contingencies 
were initially arranged. This arrangement resulted in no behavior change. 
Hopkins explained this lack of effect when he said: 

If the response never occurs, no reinforcement is presented. The 
behavior never comes into contact' with the reinforcer. Therefore, 
the frequency of the response cannot be increased. [p. 125] 

Such a statement could explain the absence of effects in our arichmetic pilot 
study. Accordingly, since the arithmetic performance of pupils in the first 
rhree cited studies were influenced by reinforcement contingencies, we must 
assume some arithmetic behavior was occurring prior to the reinforcement phase, 
ihe pupils were not in the acquisition stage. Further, since the performances 
of those pupils were amenable cc change, they had not, prior to the involvement 
of contingencies, reached criterion. The pUpils were in the proficiency 
stage. 

The results of studies which used instructions (telling someone wfiat to do) 
as interventions have yielded inconsistent results. Lattal (1369), for 
example, found instructions to be an ineffective tactic. His study d^lt with 
eight delinquent boys v;ho were deficient in self-care behaviors. The primary 
problem was their lack of dental hygiene. When the boys were told to brush 
their teeth dally, nc more t\pn two each >ffy compi ied with the request, 

Lovitt and Smith (1972), however, found instructions to be effective. The 
^^bject of their research, a nine-year-old boy was deficient in language abilities. 
Prior to instruction when he was asked to tell about some pictures, he replied 
w th short sentences. Host of the sentences began with This Is ' and were made 
up of five words. When instructed to vary the beginnings of his sentences, 
the boy readily compiled. Wb^n instructed to make his aeirtonces longer, he 
spoke in lonoer sentences. 

lr-3:ructions , unlike reinforcement contingencies, when used in acquisition 
situations, could influence the behavior of concern. instructions, like 
reinforcement contingencies, are mos^t apt to alter behavior in proficiency 
situations. Instructions, however, would probably be ineffective if used in a 
case where^the jbject did not want to perform the task, even though he was ' 
capable. 

There have been a few studies designed to compare^ the effectiveness of 
instructions and reinforcement contingencies. Burgess', Clark and Hendee (1971), 
for example, conducted a study to evaluate the effects of certain interventions 
on picl<ing up trash in a movie theater. When lltter-bag? wore provided and 
the children were instructed to use them, the audience responded by returning 
a gre^t deal of trash. When the audience wa^paid for returning litter, even 
more trash was collected. Although reinforcement contingencies were most 
effective in reducing the amount of litter left in tho tlieaters, instructions 
positively influenced picking up trash. 



The purpose of this research \^bs to determine whether i^st rucc ions , 
reinforcement contingencies and their combination would influence children's 
arithmetic performance. Furtner» we wante^ to determine tlie differential 
effects of these interventions. Throughout this research the pupfls weVe 
involved in proficiency situations. They could perform the arithmetic 
problems, but very slowiy. Our decision to arrange proficiency situations 
vyas based on the preceding studies relevant to reinforcement and instructional 
interventions. 

Gene ra I Net hodo 1 ogy 

ftal ionale ^ 
. — ^ ^ 

Often, children know how to compute arithmetic problems, but do so very 
slowly. These children take too much time to complete tiieir aritiTmetic assign-' 
ments and are occasionally required to stay in from recess or remain after scnool 
until their work is finished. Although pupils such as these hove acquired the 
ski!) for performing the problems, they are not proficiuPt. - / 

In many circumstances when individuals have recently acquired a skill they 
emit the behavior very ^del i berately . When a secretary, for example, first learns 
to take short-hand, she writes slowly and methodically. The secretary is not 
proficient. When a ih\]d first learns, to compute arithmetic problems, he 
follows the samp pattern. He first acquires the skill but a fair amount of 
tine is required to answer each problem. Eventually, after he has responded 
to many problems in a reinforcing environment, his spet.i increases. He becomes 
proficient. 

if a child does not increase his speed, his rates become more and more 
discrepant from his peers. In such instances, the teacher most arrange remediation 
tactics to help him gain proficiency. 

In this resea^^ch composed of thrf'e p.irts, v;e investigated the effects of 
three interventions on ar i thmet ic prof ic ? ( ncy. In Part I the effectiveness, 
of an instructional statement directed toward increaso(^ computational speed w:.s 
investigated. In Part II reinforcement contingencies '^ontingent-freetime and 
contingent-toys) were studied. In Part III, instructions as used in Part I 
were paired with a reinforcement contingency used in Part II. 

Subjects 

Seven boys, ranging in age from eight to eleven, participated in this 
research. All vv/ere referred from a local school district to the Experimental 
Education Unit because of academic deficiencies. They had been labeled, 
at one lime or another, as learning disabled. 

Settin g 

This research was conducted in the Curriculum Resjc.rch Classroom at the 
Experimental Education Unit of the Child Development and Mental netardatior^ 
Center at the University of V/ashington. This classroom exists for the primary 
purpose of conducting educational res<iarch: to study the efficacy of curricular 
materials and teaching techniques. Children are assioned to th* classrv:'Oi* 
for one year, then they return to their home districts. 



Rel iabi 1 icy 

Three types of reliability were cbtained. The first dealt with timing. 
The subject's of this research timed their performances. Each child had d stop 
watch, turned it on when the experimenter said, ''Start working'' and turned 
it off when the experimenter said '^PencPs down.** The experin^nter also 
timed every performance. Experimenter c.nd pupil timings agreed y9.7% of 
the time. 

r»Se second reliability measure was concer led with accurate correcting. 
Ai the end of eacL */eek the experimenter gave ^ classroom teacher all the 
arithmetic oages the children "had workec on during that week. Thd teacher ^ 
randonly selected ten of thase sheets to recorrect. Only two problems 
were found to miscorrected durir : those checks. 

The third re 1 i a^ 5 1 1 ty' measure was, concerned with accurate grapKhio. 
All data plots were rechecked us-ng the raw data sheets, ff data were graphed 
Incorrectly, the plots were changed. The correct plots app ar on the graphs 
used in this report. 

Hater! a 1 Construct ion . ^ 

The criterion for selecting problem ^types was that a child's correct 
rate not exceed two thirds of the rate of his peer group attending public, 
school. 2 Once problem types were selected for ^^-ach child, arithmetic sheets 
vyere constructed. * , ' 

The specific arithmetic-fact problem'Tj^pes-^used are discus^^d in each* 
part and are displayed in Table 1. The method ufed for constructing the 
arithmetic pjges remained constant throughout this research^ If, for example, 
add i t ion'-fact problems which yielded a two-digit c)n$wcr -i-g were selected, 
all of the one-column addition problems wh*Fth give a two- digi t answer were 
identified. Five different arithmetic pages v^ere then constructed for 
the problems, by the use of a table of random numbers. Since there are 
only ^5 problems in this pool, problems were used 'rrot'e than once. 



Insert Table 1 About here 

. . . * . . * . . < « •^■'.•'4 

CD , 



^Three different populations of children were samplcJ to determine 
proficiency rates. Thjs v^/riter tested one school's third and fourth grade 
children on various fact problem types. Proficiency data were also gathered 
from two other sources: three Special education classes and a group of fifth 
and sixth grade^ students. The mean correct rate for those groups on arithmeti 
fact problems was 50. 
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Pes } gn 

The data- from seven children are included in each part of tliis resea^C'i. 
Each experiment used an ABA design. The c.ildren's initial correcc rates 
were no greater than tv/o thirds the average speed of their pee*^ group ^ 
atterded regular ouL'ic school. If a child performed a problcn. type ai a 
soec:d above this level during the baseline oerLod, hew problems >ve re arranged 
for him. 

Each condition conducted in this research ran for at leasi seven datri days 
and was concludes only wh n the last four data dav3 were eiiher deceln^ra t inq 
or accelet-r^tfng at a speed no greater than XI. 2. 

Gene ra 1 P roced u res 



Every d^y each child was required to work on arithn^ctJc pages for one 
minute. On successive days a different arrangement of prublems was used. 
Each day the subjects were told to put their names ancJ the day's date^.on 
the top of the first arithmetic paue. Next, the experimenter said, 'Ready, 
start working.*' At the end of one minute, the experimenter said, '^Pencils 
down." The papers v/ere then collected. 

Next, the experimenter ciu:cked all the pages. Partially completed 
problems and skipped problems were not counted as being correct or incorrect, 
'ihe number of correct and incorrect answers were entered on score sheets, 
and the data were graphed. Since .ne-ninutc timings were used, the nj^jmber 
:>f correct and Incorrect answers for each set of problems equaled the correct 
and error rates . 

\ At the ^concluj5^'on of each .cond i t ion , medians, median slopes and percent; 
of-change sdores were calculated for each set of problems. A perc.nt-of- 
change score was calculated to snow the amount of change bcLwoon cor^Jitions. 
This figure indicates the amount of change from the median (Hd) of one 
condition to the median of another condition. This score is obtained by j 
using, the following formula: 

Md2 - Mdi y 

_ A ]gi> = percent of change score. 

For example, if the correct rate median of the basclinu condition was 
10 and the median correct rate score from the intervention condition 
was 15, the difference between the two scores was five. ThJ difference 
between th two median scores is then divided by the median from the bastLline 
condition ^ . The percentrof -change scdre in this 'bxample' is ^jO%, 

Each part of this research employed slightly different procedures. These 
are discussed under the appropriate sections df each part. 



3The median slope for each condition was obtained by calculating 
a line through the data points which allov;s for the smallest amount of 
variance by using unsigned medians. These scores indicate the directionality 
or trend of ithe data* Scores indicating that th^ chi ldren were beccr-.ing 
faster in j^eir computations within a condition are prefaced by an X". 
A > s ign /fnd icates tha'^', a child Was computing his problems slov/er at 
the end 6f the cqp^tion than he was initially. 
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Part I 
Instruct ions 



Seven children participated in this study. The same Intervention tactic 
was used with each child. The purpose of this research was to determine 
whether telling a child to solve arithmetic problems more quickly would positively 
alter his correct rate. This tactic was used effectively by Smith and 
Lovitt {1971) to increase a child's reading rate. 

Procedures 

All the children received the same problem tv^es. These problems 
vvere the addition-carry facts, the top and bottom addends were single digits 
(ranged from one tc nine), an< sum was a two-digit numeral (ranged 

from iO to 18). 

The same procedures were used with the seven children. A baseUne- 
intervent ion-return-to-basel ine format was followed. Specific procedures are 
discussed by condition. t 

Basel Ine . No instructions- feedback, or reinforcement con* ngencies 
were in effect. The children were told only when to start and stop working 
on thei r problems . 

Instructions . During this condition the words, "Please do this page 
faster'* were written on the top of each child*s^page of problems. Before 
the child worked his problems, the experimenter came to the child*s desk, 
pointed to the page of problems and said, **Please do this page faster." 
No other statement wa^ made by the experimenter. 

R eturn to base 1 lne > Baseline conditions were rescheduled. 

Resul ts 

Table 2 shows median performance scores trends and median percent- 
of-change scores for the seven children rer each condition of tlie study. 
Discussion of the resuUs are presented by condition. 



Insert "cvle 2 About Here 



In addition, the data from one child were selected to report. Stephanas 
performance during this part was representative of the othei six children. 
His data are displayed in Figure 1. 

Insert Figure 1 About Here 



Baseline, fn the Baseline Condition, the median correct rate for the 
chi fdred \;as 15-5 problems per mirute (ranged from 9-0 to 2.0). 



Four children obtained median error rates of 0.0. One child had a 
median error rate of 3-0 and two others obtained medioo error rates of 
1 .0 or lov/er . 

Stephan, during this initial condition, obtained a correct rate niedian 
of 1^.0 and an error rate median of 0.0. His correct rates ranged from 
7.0 to 18.0 and hrs errors from 3.0 to 0.0. 

In struct ions . When instructions were given, the correct rates of all 
children Increased. The percent-of-change scores ranged from G% to G7%. Tht 
median change for the seven children was 2h%. The error rates for two 
chilH^en increased. Tf.e e, ror rates for the other children eit)i^r maintained 
or decreased from^the preceding condition. '^-"^ 

Stephan obtained a correct rate median of 19.0 during the instruction 
Condition. His error rate median was 0.0. His correct rate scores ranged 
from 15.0 to 20.0 and his error rate scores from I .0 to 0.0. When comparing 
the Baseline and the Instruction Conditions his correct production i'fecreased 
' by 35'^. 

/ 

Return to Base line. When the instV^ctions to work faster wore discontinued, 
median correct rates of four chi ldren\decreased . One child retained the median 
level of the prior condition and the cVcrect rate medians of two children 
increased. The median percent-of "change &<;^e for the sever, children was ^3^ 
(ranged from -llfi to -^YhZ) . 

During this condition none of the error rates increased. The error rales 
for two children decreased 75%. The error rate median for the seven children 
was 0.0. 

During this condition, Stephan's correct r^^te median score (19. 0) was 

the same as in the prior condition. His error rate median score rose to 1.0. 

His correct rate scores ranged from 17.0 to 21.0; error rate scores ranged ^rom 
3.0 to 0.0. 

Di scuss i on 

Seven children participated in this research. An ABA design was us^d. 
Their initial performance levels indicated 'he pupils wore too slow in 
computing arithmetic problems. In each case it was possible for the children 
to ccpute the problems twice as fast as they had initially. 

All of the children's correct rates increased when they were told to 
solve problems more quickly. Uo appreciable rise in the error rates were 
not'^d. Although none of the children attained a proficient correct rate, the 
instructions influenced positive changes In the children's correct rates. 
Not only was this technique effective, it v/as inexpensive in teacner time (less 
than 30 seconds), ond d'd not require the use of elaborate arrangements of rein- 
forcement schedules. Vihen the intervention v^as witfidrawn, the correct rates of two 
children continued to improve. The correct rates for four childrv^n, hov/ever, 
declined during this condition. 
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Rei nforcement Contingencies 

Two intervention tactics were investigated in this part of the research. 
Both interventions were applied contingent on each child's correct rate 
of performance. The first intervention was cont ingent-f reetinic; the children 
earned time to spend as they desired. After the completion of the Contingent- 
freetime Condition, a second intervention was applied. During this intervention 
the children earned points v^hich were redeemable for toy models. 

Procedures 

Addition-carry facts were used for all seven children. The same pro- 
cedures were used for all of the children. After the baseline period the 
cont ingent-freetime intervention was scheduled. When that condition was 
concluded the contingent-toy intervention was applied. Following this, 
baseline procedures were rescheduled. 

Basel i ne . No instructions, feedback or reinforcement contingencies 
were in effect. 

Contingent freetime . During this condition, the children were al laved 
to earn freetime. the amount of time they earned was related to the number 
of correct answers. 

A forjnula was used to calculate the ratio for each child. First, 
the median score for the baseline pe-iod was obtained. That number was 
divided by five, and that figure was used as the number of correct problems 
each child had to solve to earn one minute of freetime. If, for example, 
a child had a median correct rate score of 26.0 during the Baseline Condition, 
26.0 v/as divided by five. This child had to solve five problems correctly 
to earn one minute of freetime. in this way, a child earned five minutes 
of freetime each day if his correct rate equaled the correct rate median 
of the prior condition. If he surpassed his correct rate .':>edion of the 
Baseline Condition, he earned more than five q»inutes of freetime. 

Daily, before the arithmetic pages were given to the children, the 
experimenter noted this ratio in red ink on the top of his page of problems. 
Before the child worked the page, the experimenter came to his desk and 
explained the ratio to him. If 5:1 was written on the top of a child's 
page, the experimenter said, "For every five problems you do correctly, 
fju will earn one minute of freetime.'* No other instrucjons were providerj. 

After the child computed the problems, the experinenter collected 
the page. She checked it and calculated the amount of freetime he had 
earned. The pupil was then told how much freetime was allowed. That number 
was entered on a sheet of paper posted in the room to insure that only 
the earned amount of time was spent. No praise was given a child for his 
performance. 

Various activities were available only during freetime. The Freetime 
Room was a small room adjoining the classroom. In the room were many games 



and puzzles. In addition, two gerbils cojJd bv,' removed frofp their cage 

and played with in the Freetime Room. Sc.ie children brought items from 

home; others worked on shop projects. ^^Once an activity v/as used durino ^ 

freetime, it was available only Juring\hat time. Th<3 children were permitted 

to spend their freetime when they desired. They could not, hov-vever, save time for 

more than two days . 

Contingent toy . Du r i ng^'t h i s condition the children earned points 
which were redeemable for toy models. The ratio in effect during this 
condition was the same as the Cont ingent-f reet i.tie Condition. Toy mo-'' Is 
were priced for each child^by using the following formula: median or the 
fontingent-f reet ime Condition divided by the ratio multiplied by six* If 
in th^, previous condition the correct rate median was 19.0 and the ratio 
was ^:1, 19.0 was divided by four ' j . The ansv/er, five, was then 
multiplied by six (5 x 6 = 30) . The cost' of this boy's toy toodel was 
30. The division step in this formula ind icated' the average number of points 
the child earned in the Cont ingcnt-f reet inie Condition. If a chjld retained 
his level of correct performance, he earned a toy in six days. If he increoscd 
his correct rate scores, he earned the toy sooner. 

On the day the cont ingent-^toy-model intervenrion was initiated, the 
Chi Id was allowed to select, from "a large number of toy models, the one he 
wanted to purchase. These toy models were of tiie unassembled variety. 
Various types of airplanes, cars and boats were included in the selection. 
The average cost of each toy model was one dollar. Written on an index 
ca.^d was the boy's name and the point cost of his model. After^ he selected 
his rpodeK, the Index card and the model were placed on a shelf in the front 
of the classroom. 

Each day. before the pages of problems were given to tiio child, the 
experimenter noted the ratio in red ink on the top of the child's page. 
Before the child worked the problems, the experimenter came to hts desk 
and explained the ratio to him, as she had done in the previous condition. 

After the child computed problems on the page, the experimenter took 
th'^. page from the child, scored it and calculated the number of points 
he had earned. She then went to the boy's model and reduced the cost 
by the number of points Ue had earned that day. /hen the :fuld errned 
all the points necessary to purchase the model, the model was given to 
him. We then selected another model and began working for it. 

Return to basel i ne . (io instruct ions , cent ingi^nc ies or feedback v;ere 
scheduled during this condition. 

Resul ts 

Table 3 displays the correct and error rate meJiuns, tr^:ntis and median 
percent-of-change scores for the seven children for each condition. A detailed 
description of the resjlts for all of the children is found within the 
condi t ion headings . 



Insert Table 3 About Here 
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Since two ir t-ervent ion tactics were i rives (. iya ted durincj this part 
of the research, the data from two chlicren were selected to disolay. 
One child showed greater gains during the Cent ingent-freetirae Condition; 
the other child improved n^ore during the Contingent- toy Condition. Stephan'5 
data are displayed in figure 2. Rip's data are shov^n in Figure 3- 



If^sert Figures 2 and 3 About here 



Basel i ne . In this condition, th^i correct rate medion for tne seven 
children was 21.0 (ranged from 9.0 to 33.0). The error rate median was 
0.0 (ranged froiD 2.0 to 0.0). 

Stephan, during this condition, haa a correct rate t.iedian of I9.O. 
His error rate median was ] .0. His correct rates ranged from 17.0 to 21.0, 
error rates ranged from 3.0 to 0.0. 

Rip, during the Baseline Condition, obtained a correct rate median 
of 26.0 and an , error rate nedian of 1.0. His correct rat is ranged from 
18.0 to 32. 0; error rates ranged from 10.0 to 0.0. 

Cont ingent f reet ine . seven children received a correct rate median 

of 21.0 and an error rate median of 0.0 during this condition. Their 
correct rate medians ranged from 13-0 to 36,0, All the children obtained 
arror rate medians of 0.0, The correct percent-cf -change medi^xn was 19^ 
(ranged from Q% to 52^). 

Steohan's median correct rate was 20.5. his error rate median was 0.0. 
Stephan 's correct rates ranged from 13. 0 to 23.0; error rates from' 0.0 to 1.0. 
ywhen his correct rate in tl^is condition was compared to chat rate of the 
/previous phase an Q% improvement was noted. 

Rip increased his correct rate by 19/. during the Cont ingent-f reet ii'»u 
Condition. He obtained a correct rate median of 31.0. His correct rate 
scores ranged from 27.0 to 36,0. His error rates rant,jd from 0.0 to 2.0. 

Cont i ngent t oy. The median level of correct rate improvement during this 
condition was 19^ ranged from 0^ to 52^). The children received a correct 
rate median of 2C 0 (ranged fro^ I6.O to 35.0). Thrce^ of the cf)i Idren "increased 
their error rates. The error rate median, hov'ever, was 0.0 (ranqed frgn 3>0 
to 0.0) . 

Stephanas correct rate median ^^as 26, 0^ an increase of 2 i'^ over the previous 
condition. His error rate median was 0.0. His error rales remained constant. 
Stephan '5 correct rates ranged from 22.0 to 29.0. His error rotes ranged 
from 2.0 to 0.0. 



Rip's ccrrCct rate median was 33.0, his erroc; rate median was 2.0. itis 

correct rate increased G% v^iOn ti>e cont i ngont- toy interven^ion wab in effect. 

His correct rate scores ranged ^rom 27.0 to }C.O. His error rate scores ranged 
from ^,0 to 0.0. '1/ 



Return to baseUnc. When the cont i ngcnt- to/ intervention was withdrawn, 

the correct rate medians decreased for all of the children, Tfje n>cdion child 

1 

J 
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lost The correct rate median for the seven children v^-us 23.0 {ranged 

frcni 12.0 to 36.0). The median error rate was 0.0 (ranged from 3-0 to O.Oj. 

Stephen's correct production decreastid by 12%. He obtained a correct"' 
rate median of 23-0 (ranged from 20.0 to 27-0). Hi<; error rate meuiun was 
0.0 (ranged from 2.0 to O.O) . 

Rip's correct rate median decreased by 3%. His correct rate median was 
30.0 viith an error rate median of 2.0. His correct rates ranged from 22. C 
to 3^.0. His error rates ranged from o.O to 0.0, * 

Discuss ion ' 

When the children could earn freetime for their correct., per formance 
most of the children's correct rates increased Only one child's correct 
rate median score did not increase during tliis condition (^s indicated by 
a percent-of-change score of 0^). When the contingent toy intervention was 
in effect, again, all but one child's correct rate increas-^d. The median 
increase for both conditions was 19^* The gains made, hovvever, when the contingen- 
cies were in effect were not as great as those made wnen the instruction 
tactic used in Part I was scheduled. 

When baseline procedures were rescheduled, all the children's correct 
rate medians decreased, Howevc , the ch i I dren ' s correct rate medians during 
the Return-to-baseline Condition were higher than their initial correct rate 
medians. No appreciable rise in error rates were noted during the course 
of this part of the research. IJone of the children, however, obtained a 
median correct rate during any of the conditions which indicated they ob- 
tained proficiency on t^e. problems presented to them. 

Althougii the median correct percent-of-change scores for both interven- 
tion tactics was equal y the percent-of-change scores hao a wider range 
when the cont i ngen^t-f reet ime tactic was scheduled. The percent -of-change 
scores ranged from 0^ tp 52^ while the contingent-f reetime tactic was applied, 
and from 0% to 21^ when the cont i ngent-toy intervention was scheduled. In otlicr 
words, several children made greater gains when the cont inoent- f reet ime intervention 
was in ef.'ect. This might have .happened , however, because the contingunt- 
freetirne intervention was scheduled first. 



Part Ml 

instructions Plu s Cont ingent - toy 

In the first twc parts of theVesearch, the effectiveness of two types, 
of interventions was investigated. In the first part, instructions were liicd 
wiJi considerable effect. In the second part, two reinforc*jment contingencies 
were scheduled as interventions. Both the cont i ngent-*f reet ime and the contingent- 
toy tactics positively influenced the children's correct rates. 

Frequently, tlie tactics investigated in this rcsearcli do not occur in 
isolation. They are o^'ften paired. Several studies which stt^ted thot rc»nfj;^rce- 
ment contingencies v^/ere used, in fact, used reinforcemcrjt cot^t Inaencies an£ 
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in«3truct ions (Qirnbrauer, Wolf. Kidder 6 Toguo . l^f'Ls Kale. Kaye , Whelan 
0 Hopkins. 1968; O'Leary & Becker. r967) . Statemenls like, "Johnny, if you 
do this, then you can do that/' are often heard in classrooms which employ 
applied behavior analysis tt;chniques. 

in this part of the, resea rch . the instructions in the first part were 
paired with the contingent-toy intervention used tn the second part of this 
research. The purpose of this section was to determine whether pairing these 
two tactics would cause greater changes in the children's rates than did either 
intervention v-^hen used alone. 

Procedures 

Six children received the same problem types during this part of the 
research. These children received the subtract ion-bor row facts. One child 
received the add i t ion-corry facts. 

The same procedures v/ere used with all the children, regardless of 
the problem type assigned. An ABA format was followed. Specific procedures 
are discussed under the following headings. 

Basel i ne . \lo instructions, feedback or reinforcement contingencies v/ere 
in effect. 

1 

tnstructions plus cont in gent^oy , The lost ructions used in Part I and 
the contingent-toy procedures used in Part I! were jointly scheduled during 
this condition. A point ratio was calculated for each boy using the formula 
described In Part, M. After the ratio was established, a cost for the toy 
model was established in the samo manner as previously explained. 

On th^ first day of this condition, each child selected a toy nxidel to 
purchase, ; After his selection, an index card with his name and the cost of 
the model was attached to the toy. Written on his page of problems were the 
words. *T]ease do this page faster." The ratio was also written on the top 
of his pa3e. Before tl)e child solved the problems on that page, the experimenter 
came to his desk and said, '"Please do this page faster. For every (number) 
problem you do, you will earn one point towaf§Js the purchase of a toy mode! 
Nothing else was said' to the boy. 

After the child solved the problems, the experimenter collected the page, 
scored it and calculatexl the number of points he h<id earned. She then went 
to the chi1d*s toy model and reduced the cost of the model by the number of 
poi.ns ho had earned tha* dc-^v- f^o other statements were made. 

1 f a child earned a toy model before the condition was concluded, he 
selecte3^6nother toy mde] to ectrn . 

R eturn to^ basei ine. . Baseline c.'^nditions wore " *-estubl ishod. io instructions 
feedback or reinforcement eont i ngcnc i were in effect. / 

Re su 1 ts 

^ As in the other parts of this research, a summary of V\o children's 
performances appears within the following headings. The dat'i from a rcprescnloi i ve 
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child were also selected to discuss. The correct and error rate medians, 
the median parcen t-of-change scores and the median slope scores for the seven 
children for each condition are included in Table 



Insert Table ^ About Here 



Basel Ine . In the Baseline Condition, the children's correct rate 
median was 18.0 (ranged from 15.0 to 21.5). Thoir error rate median was 
1.0 (ranged from 2.0 to 0.0). 



Rip was selected as tfie representative ^. 

in Figure '4. During this condition, Rip's correct rate median was I8.O 
(ranged from f 1.0 to 21.0). His error rate " ' 



3.0 to 0.0) . 



child. His data are presented 
- ... ...^ ^ ^orrect rate median was I8.O 

error rate median was 1.0 (ranqod from 



Insert Figure ^ About Here 



Instruction s plus contingent toy . This intervention positively influenced 
the correct rates of all children. The median correct rate was 23.0. Their 
median correct percent-of-change score was The error rate median for 

this condition was 1.0. 

Rip*s correct rate median was 26.0 (ranged from 23.0 to 30.0). a gain 
of hh% from the Baseline Condition. His error rate median dropped to 0.0. 
(ranged from 1.0 to 0.0). He made errors on only two days. 

Return to basel ine . V/hen the inter\?ent Ion was withdrawn, the correct 
rate of six children decreased. Their error rates remained neur the levels 
of the previous condition. .Three children's correct rate, medians were lov/er 
than during tne basc\tne period. Only one child continued to progress. The 
median correct rate -loss during this condition was 30^^ (ranged from -^SZ to 
'70%. ' 

OL'ring this condition, Rip's correct' rate median was lower than his correct 
rate ft)edian for the baseline period. Those rafes were^o.O and 1^.5. His 
correct r^.es during the Return-to-basc I i ne Condition ranged from 1 1 ,0 to 
18.0.. His error rate median returned to its initial level (I.O). HN$ errors 
during this condition ranged rrom ^.0 to 0.0. The decrease in correct rate 
{-k^\Z) during this condition equaled the increase in his corrcxt rate v^hen 
the intervention was scheduled^ 

Discussion 

Seven children participated in this research. An ABA desigo was used 
with. each child. V/hen interventions used in the first and second parts of 
this research were paired, the children's torrect rate medians dramatically 
increased*. Mo appreciable rises in error rate medians v/ere noted. When tlio 
intervention was witliclrawn, six children's correct rate meul..ns decreased. 



G eneral Discussion 

The children who participated in this »esearch were not proficient in 
solving certain problem types. They knew the cc/rect answers to the problems, 
but could not solve them fast enough. 

Three intervention tactics were investigated during the course of this 
research. The first intervention tactic was to instruct the children to work 
more quickly. This positively influenced all of the children's correct rates. 
The boys' median increase was 2k%. 

in Part II, two reinforcement contingencies were studied. When the children 
earned freetime for correct computation, their correct rate medians increased 
by 19%. T^ie same amount of improvement was noted when the boy'> worked for toy 
models. The correct rates of some children improved more when they worked 
for freetime; other children were influenced more Dy the contingent-toy intervene 
Only one child's correct rate median was not influenced by the contingent- 
freetime tactic, and another boy's correct rate median was unaltered by the 
contingent-toy intervention. 

In the final >art of this research, the instructional tactic used !n 
Part I was paired with the contingent -toy tactic used in Part II. The pairing 
of these interventions positively influenced the performance of each boy. 
On the average, the children increased their correct rates by 

When attempting to discern whether the effects of the instructions alone 
or rplnforcement contingencies alone were more effective, several factors 
must be considered: changes in correct and error rate medians from baseline 
to Intervention conditions, and change;* after the intervention was d i scont inued • 
When the three • ntervent ions used alone were compared. It appeared that 
the use of instructions was most Irfluential. The amount of change in correct 
rate medians was most when Instructions were in effect. The loss in correct 
rate medians was s'ightly less when comparing intervention and return-to- 
baseline medians. Although lower error rates were noted during the Contingent- 
freetime Conditions, five children obtained error rate medians of 0.0 when 
instructions were scheduled. It seems that using instructions is more powerful 
than the results from other studies have indicated (LattaJ, 196^; and O'Learyj 
Becker, Evans o Saudargas, 1969). 

One reason for attempting to discern the differential effects of the 
intervention tactics used alone was to determine whether certain elements 
of contingency management procedures were mor** '.if luentlal . liany studies 
have utilized token reinforcement* Often, the subjects were instructed as 
well as reinforced for appropriate behaviors (O'Leary & Becke*' , 1967; 
Parsons, 1972, and Wolf. Giles Hall; 1968). The Important role of Instruc- 
tions is apparent In an acquisition situation (Hopkins, t96o) . If the desired 
behav*9r is not vyithin the repertoire of the subject, It does not occur; and> 
therefore, cannot be reinforced. The role of instructions in proficiency 
situations is not as apparent. 

In Part III, instructions were paired with the cont i nqont • toy tactic. 
The median change in the children's correct race medians was Since 
this v/as the greatest amount of change noted v/hen an intervention was In 
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effect, apparently, both taclics (instructions and contingent reinforcement) 
contributed to the imount of gain made by the children. On first glance, 
it appears from the group data that each tactic contributed to the total 
amount of gain for this condition by the amount of influence they had when 
used separately. This occurs because the median gain of the Instructions 
Condition (2^1^) when added to the median gain of the Contingent-toy Condition 
(19%), closely approximates the median amount of change made when these 
tactics were paired (^^%) . The percent-of-change scores for individual 
children did not, however, support this notion. Some children made greater 
correct rate median gains when the i ntervent it>ns were used alone. Only 
one individual's data indicated that an additive-effect might have occurred. 
Whatever the interaction between the two tactics when used together, instructions- 
plus-contingent-toy intervention was the most effective for the seven boys. 

There are several implications which can be drawn from the data gathered 
during tlys research. First, children's computational proficiency can 
be altered. Both instructions and reinforcement contingencies, when focused 
on computational speed, can be positively influential. The greatest amount of 
change in tiie children's correct rate medians occurred when instructions and 
the con':ingent-toy tactic were paired. Possibly, tactics which combine 
•nstructions and reinforcement contingencies should be used first by teachers 
wnen Iheir students' computational proficiency needs improvenent. 

Th.ese implications, must be tempered by at least one limitation. No 
control for the order-effect was arranged in thi*s research. The interventions 
were scheduled for all of the children in the same order. They first received 
instructions then cont i ngent-f reet ime , contingent-toys, and, finaljv, a combination 
of instructions and contingent reinforcement. In addition, the Interventions 
were scheduled for the children at about the same time of year. Christmas / 
vacation night have confounded the results of the instructions and the end- 
of-the-school year, the combined tactic. Other studies which control for the 
possible order effect noted in this research should be conducted to determine 
more conclusively the differential effects of the interventions. 
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F i gure Capt ions 

Figure ) 

Correct and error rate data for Stephan's arithmetic problems for Part I. 
Two types of (}ata plots were used: dots indicate the correct rates, triangles 
the error rates. Plots placed on the solid horizontal line indicate a rate 
of one. Plots placed on the broken horizontal lij^e indicote a rat^ of zero. 
Onlv successive calendar plots are connected by lines. Solid vertical lines 
mean tiiat exf :»r imenta t conditions v/ere altered. 

Figure 2 

Correct and error rates for Stephan's problems during Part M. 
figure 3 

Rip's correct and error rate data for Part II. 
F igure k 

Rip's correct and error rate data for Part III. 
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OH 1 THAT Shis TOO TOO 'sol rO FLESH WOULD MELT 
(THE EROSION OF ^ACHIEVEMENT TESTS) . 

^ ' Tom Lovitt and Marie Eaton • 

•|| . ^ X ^University of Washlngtdn * 

V / - . Abstract 



\ln this article the use of achievement t^sts to measure V^demlc dev^^.^ 
oproent, particularly in regard to reading. Is examined, plr^itt and Ddil.y - 
measuremenr Is re^mmended'as a replacement for the aehiavemtnt test ^^pproach. 



The two systems. are cdmparediri regard to three -s^s of measurettent^ ^ for • 
placement, evaluation and coqjmunlcatlori. In-order to make these comjiansons, ' 
achievement tes.t scores and Direct and Daily measur*ement/|«(ere o^b.tS^^ ^^om 
13 children over a two-year period. In this repbrt both sets 6f data-acM.eve 
ment test scores and Direct and Dally measurement-!- from three pupils- are des- 
•cribed in order to 'compare the two systems. 



V ' OH! THAI THIS TOO TOO'. SOLID F.LESH- WOULD MELT 

(THE EROSION of' ACH I EVEMENJ TESTS) ^ " - 

•* * *• ' ' ' *•**%•• 

^ . ' • . ^ Tom Lovltt and Mar.ie'EatonN^ ^ v 

^ • ^. Uftlversi-ty of WSshitigtonl - - , S 

'.^ . •• . . ., " . y. ^ ■ 

. <- At the-beglnning oT*the school, year 'rfeny eTemerttary^^phpo Is throughout 
the country .^minister aphlevement tests. In^others the-^ *re given In the 
spring, near the end of the year. Some elementary schools .acjmitilster them 
in the fall and 'spring. ■ ■ *. ^£ ' ^ •• 

• "the scores from tfieSe .tests are generally used for three purposes: for 
placement, for evaluation and fbr .cpmmunlcatlop. In some schools a child's 
achieveinfcrtt test score Is the primary data considered for hii^laceijient Iq 
a particular teaching environment. Often achievement test scores are used 
to evaluate reading prpgrams. In. many parts oiF- the courftry. they are used, 

' o 

along with othe,r academlclnformat Ion, to Indicate the s.cho.lastic develop- 

■ . i ■ . . ^ 

ment of children. ' . . 

Although there are many achleveinent. tes;ts, which are used, to measure • 
several academic. behaviors, .this report Is concerned with only. f wo achieve;.. ..^ 
ment tests and "the •measurement of /reading.. 'Hopefull y many of tb e remarks 



here, although derived from tJb tests and the measuremen't' of .reading, will 
be 'pertinent to other achievement -tests" and the measurement of other .subjects 

There have alwa/s been indri vidians who ra|?ed at leas^t moderate crltl- 

' ' /■"■*" 

cisms against the use of standardized .achievement tes^f to measure the 
development .of readi'^ig skills. Teachers, from^^lme to. tlm^, haVe expressed 
some dlscnchantmfent regarding the resultsof, achievement/tests: They have 



.n(/ted thaysuch tests do not always 'measure the reading skills that were 
taught. ^ , Some parents, when.^shpwn the. test scores of their children, have/ 

been uncertain as to^how. to interpret the data. Reading expert;s have occa- 

\ [ ^ • . . ^ ^ ^ , ^ ' 

stonally expressed dissatisfaction with achievement tests. For example^ 
Strang (1968) suggested' that the time and money spent in developing,^ admin- 
istering and scoring achievement tests could, be bfetter used in training 
teachers to observe the dally performances of their pupilsi 

^Recently; criticism about the use of achievement tests^ has been more 
widespread and ce.rtaihly more fbipass loned/ ^Many of t6day"s arguments are 
more* than rhetorical. Much of the cf»itici^sm concerning the use of achieve- 
ment tests stems from the fact that scores from those tests are now being 
used to determine the effect! veness^of reading programs in many cities. 
The case of the evaluation of the reading program-in New Vork Ci^y is rep- 
resentative of the reading evaluation dilemma faced by seyeral school systems 
Yearly In that city, Metropolitan Achievement Tests ^re administered to 
children in elem^ntar/ and Intermediate grades. . For the past few yeal*s, 
according to the norms of those tests, more and mor6 New York City children 



were readi-r^ below average. According to the 1973 test results, 66.3^ of 

K 



the elementary children arid 71.3^ of the Intermediate children were reading 



belqw their grave l^vel. These data indicated thar~lTri6 of-ttTe^~ctty^s-3H 
decentralized community school districts, at least half of the Intermediate' 
pupils were readjng two ar more years bejow grade level. ^ 

Naturally, there were 'refections to the reporting of those data. The- 
Fleischman Conimiss ion, . wh 1 ch recently completed a study of education in New 
York State, used the achievement test data to support the following r^ecommen- 
dations regarding the instruction of reading: a) districts should'screen 



teaching candidates for cpnipetence. in -teaching readJng; b). '^expecieneedV'te^r. 
chers sljould receive 3<j(j:tional training in. reading; c) reaching spetialists 



^ould'be hjred; d) reading shouJd be etnphas.ized in other subjects, .e.g. , 

science; and y4) flexible reading programs- sho"uldJ?e developed. Implicit In 

these >econiniendat ions is the as.sumpt-lon thax the method for. evaluating reaqr.^ 

ing— achievement tests-^-jsh^uld pot be .thanged. ^ . * 

■ Albert Shanker, President of the Uni.ted Federation; of TeacheV§ in New 

York City, responded kl /behalf of the* teaphers. he- represents In regard to the 

low achievement test scores. He said that pupil mobility accounted in large 

measure for the low test scores • He pointed out that In New York City the 

moblUty of , pupils is so great that. in many instances fewer ,than half the 

children tested one year in a given grade, school or district were in those 

< . . . r • 

.same locati^s the year before". He contended that the low scores could have 

occur r^'ed because several thousand high-achieving students moved out and were 

• • / F ' ' ■ . " • ' . . ; . - 

.replaced by lowrachieving students. One of Shanker 's recommendations was 

• . ■ . ^ . ' . . - ' . > . • ^ . » , 

that<?more money shouW be devoted to reading instruction. Apparently, Shanke 

,like the; Fleischman Commission, w^s wHJing to continue to us^^hievement 

i^si^ to measui*e reading development. * 

t Shanker* S' explanation for thi low scores ell.clted, in turn, a reactipn 

, from Professor Kenneth B. Clark. Clark, a*member of the State Board of, 

■ ; . . ' - ^ ■ . >. ' ^ ■ . . . 

Regents, remarked that the clty*s school bud^ef had risen by more tfian 300^ 
percent since 195^,- whi le reading stores oveV the same period had steadily- 
declined. Clark believed the lov/ city-wide scores were ^'directly ''a functlpn 

A . .-.^ . . . ; 

^ of the ' fact tha| these children are not being taught,* and th<^y*re not being 
taught because they*re^n.ot respected as human -beings— they are rfllbrded as 
subKumans, as noneducable; They are isxpected .to fai New York Times , >^ 



December 3, 1S73)-. Judging Trbm those cornrnents, Clark rs a'iso apparently an 

' -If ' " * ' * ' . 

ad\<gcate of the use of achievement tests to monitor readin^j growth. _ 

Meanwh'ite, an alternate /viewpoint was offered. .Herrnan LaFontaine, head 

. • * . • • - ' , ' . ^ : 

of bilingual education for the New York City schools, expressed his sentiments 

about achievement tests'by taking some Ul^^ties with Ham1e<,'s sdliloquy: ' 



To ^est, or^nof to test,, that is the-questipn.. , • . 
• -Whether •tis hobler in the mind 'to sUffer'^ * V . 

. the slings and arrows'of outrageous measure- • 
• ment> or to.take,ai;n\S'^against a sea , -« , : . 

of standardized tests and/by opposing end . . ^ ' ' \ 

^ . ^theip. ( New York Times; , Mkrch 25, 1975) 

. It 5s quite obvious that UFohtaine, unlike^the Fleischman Commission, 



Albert Shanker or Kenneth Clark,>as displeased' with .the us^e^ of achievement 
'tests to evaluate -reading, ^ccor^iling to his parody, however,, it is not clear 
.whetifer he favors^^our ^cont i nuing' to use the current tmeasurement system, or 

wf^h^s to oppose this system by developin^g a counter-approach. ■ / 
In the remainder of tMs article we wouWlike*td accept laFontaliWs 

final alternative in- regard to .achievement 4:ests , *'to take arms against a sea 

of standard izfeji ^sts and-by opposing end them.'*-' Jn addition to criticizing 



the current mcastjrement system, we will, throughput. ♦'hJ^ -paper, offeY an 
alternative measurement system. '\ ^ ' \ ' p. , 

Thi:^ alternative approach, C3^ten referred to as Direct and Daily measure- 

■* • <■ \ 

ment, has a rich heritage: The research literature regarding the use ^f this^ 
system*to measure academic performance,* al though recent, is 'quite substantial.: 
More vnII be* s^I^i" throlighout this paper atdut the elements of Direct and f?aily 
.measurement; so for the time being, we wiTl provide only a brief explanation 
•of the terms^^^direct'*' and *»daily.'; •^Direct'* simply means^that if reading 
orally from a Uipp.incott reader is the behavior of concern, measurement would 



4 



'..'ie -Ot>tal,-oed as the puplj read orally from a Lfppincott reader. '^Daily" means'. 

• . ' that', «neastJreij»ent' would be obtained, If not' daily, very often. 

• ; '~>i"- • 5 " , 
* Relevant to the topie of tlii.s paper; many studies using Direct and Daily 

♦ . .* » X . 

r jme'asuremenn have '^.^^^^ v!?here various .read? r>g. performances werp evalu- 

' " .J ' ■ ' ' 

V',^at(^L ,^rdinan-{l uaiiured several components of p^'e- reading.,, such as > - 

: visual and-*auditoYy dUXrlnji^ibn. ^taats (136^) measured-severaHreading - 

y : behaviors^' among* them Mdejjt I fyfng letters and answering comprehension ques- ^ 

.* » tlons:Nw? ^(Lovitt,"'l973) have. ^Qhducted several studies where oral and silent 

^re^tng and cM>swer*ing cotnpreherisionv questions were measur'ed. 

Iniorder.to present',Oi^recfc'' aH^V&a^y me^sufeirtent^s an alternative eval- 

uatf<;rt §,v^tem/%kat methpd willvbe conipared to^ the achievemei. test system- 

. \ . . ^- _ ? ' ' ' \ . ' ' \ , . ^'.^ 

'The^l^p appr^ach^^ will bp- contrasted in re^lrd €o the three purposes for ' 

, ^ obtajfTirt^ Wasur-emeht: ' placement, evaluation and feonvnutiicat ion. . 



^ • . ^ SETTIN8i\N0 SUBJECTS . 



i'^ The Sj^ttirig was the Curricyjujft Researgh Classroom in the Experimental 

' V , ^ \ ' " . , * ' . . ' • 

* Education Unit,. University df Washington. * TKe Experimental Education Unit 

- ^ ^ ' ■ ^ ' % ' . . * • ' ' - > - . 

. i:orj)p>iseS^. 14 classrotoms for ^xcej>tio(j^l children ranging in age> f rom 5 to 18. 

TKe primary *purpo|e o-f thts unif^s to inves.tiga'te-iiiate rials and procedures 

that -are currently ni^^^ tp^udate exceptional children.^ A further purpose^ 

^ ' is ^to, design new approaches for the>education of these chi Idren. The speci- 

^/ flc purpose' of tffe Curriculum f^esearch Clas^rbo^ri Is to investigate techn^ique^ 
. ' . ^ • '\ . ,v * ■ ^ . >C. ^ . , - ' 

J used wi^h elertientary and intermediate age thildreo with , specif i'c leaff-ning 

prdblems. " . ' . . ^ *^ " 

: The subje"c/% In this report-.wer^ l2^boys and'Ycne girl% pilpils in the 

Curriculum ;ie$earch Classroom. , Six were in, the ^class of 197pr7r, seven m 

ERIC ., • ■■ 



the 1971-^2 class. Thejr ages ranged from 9 fo 12. . The^pupils were generally 
characterized as being learning disabled. More specif ical Ty/ they achieved 
academically frpm one to, three years below the majority of children in their 
regular classes. Their families were middle or upper class. None of the 
pupils had perceptible neurological, physical or social problems. 

, PROCEDURES > / 

/ . 

' Three type's of^proced'ures wi 11 be^^xplained here: procedures for placing 
pupils in readers, procedures, for daily r$*adl\ng instruction, and procedures 
for obtaining a.chi^vement test scores. ' 

Placement P rocedures . 

For five days the pupils were . requi red to read orally from several basal 
readers. During the 1970-71 placement period, the pupi Is .read daily from 
three readers from one to three- series ; they '.read from three to nine ^ooks. 
During the 1971-72 year, each pupil read from th^ee readers from the Lippin- 
cott, Ginn 360 and^fank^Street series. If, for example, it was beTieved that 

'1 t ^ ' r 

a pupil could read fairly well from a 2 reader, he was *requi red to read from 
' • "* • * 

1^, 2' and 2^ readers from each series. The 1971-72 children read daily from 
nine readers. ' , ^ 

Each day, throughout this placement period, the pupils ffom 'both classes 

. • / 

read orally from each reader for one minute. The teacher tallied each correct 
and incorrectly read word. After the pupil had finished reading, the teacher 
graphed a correct and error rate score for each reader. If on one day a pupil 
read 65 words correctly and 5 words incorrectly, a plot on the graph was made 
at 65 and. another at 5* * >> 



i 



As mentioned, this proVedur^ lasted for five days. At the end of this 
period the teacher calculated a range- for all of the readers, .If ^ pupil 
rtfad from three books from three basal series, there were nine set^^of ranges: 
a correct rate range and an error rate range. The teache-r a1 so xal cutated.d 

/ sfet of median scores for each . reader-/ a correct and an error rate median? 
The median v^as the mf ddle score of eachngro^up of nwscoresT'^Fol lowing place- 
ment for the class of ^1970-71% ^the teacher selected from one to 'three readers 
for ^ach child. These choices were based on median correct and error rates. 

^ The reader or readers where the pupi'l's correct, rates were highest knd-hrs 
error rates the lowest were selected. 

^ , f 

If 'the pupil wai barely able to read orally, only one book wAs selected. 
He subsequently received oral reading instruction from that book. If the 
pupil was more advanced, two readers were chosen. Throughout his instructional 
peViod on^ tlext was used for oral read.ing, the "other for silent reading. ' If 
the pupil was still'^rnqre advanced, three re^aders were selected. He was placed 

one for oral instruction, another for silent' instruction, and simply read 
orally in tl^e third wtthQut receiving instruction. The readers the 1970-71 
pupili were actually placed in are included in Table I. • * 



TABLE 1 ABOUT HERE 



/ 



At ^he end of the pfacement period for the cl'ass of 1971-72, the. pupils;.^ 
Kere'all placed in three re*aders. Each child was placed l<i one reader from 
'the Lippiocott, Bank Street and Ginn 360 series. In every case these selec- 
tions were based on the highest median correct and lowest median error rate 
scores In the three series. During their subseqnent period of instruction,^ \ 
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i^the'paplls received oral reading instruction from the' Lippincott series, silent 
reading Instruction from the Ginn 360, and ri6, i'nstruction from the Bank Street 
^ reader. The readers the 1971-72 pupils wer.e placed in are incl/jded in Tabl6 2. 

* « 



TABLE 2^B0UT HERE . 



It should be emphasized that whether the pupl 1 s- were .placed in one, two • 

I : • _ . • ' 

. or three readers, placement decisions were based on their relative performance • ■ 

— c • ^ ' . • , 

Jn a set of readers over a period of time. 

Instruction Proce'dures ' ^ ^ . 

Following the placement of the.pupiU in readers ^ing Direct and Daily 
measurement, reading instruction commenced. For those beginning formal reading 
instruction, they read orally for five minutes each day. As a pupil read/ the 
teachei\ counted each correct and incorrecffyriad word/ If the pupl 1 ^cbu,l>d'-^ ^ 
n&t pronounce a word or mispronounced a word, the word was-^ronounceOY the 7^ 
teacher. These were the basic procedures in effect for" the ^^Ms J^*^"^ ^ 

classes. • " ^ . , ^/ ' " 

> As mentioned in the placement section, some puprl.#^\rom t^e 1970-71 "class ^ 

! - . " ' ."^ T ' J •'• " 

' read silently from a reader. Those pupils read for -five ri|Tna|es ea^ch day. ■ ^ 
The pupil who read fVom a third book simply rea^\oral ly. f rom th^t text? no . 
instructi-on was scheduled for that book. It shpuiUalso be S^ntioned t^af ' 
the pupils who read orally and s II ently ,,were^|sked^ to answer cpmprfhens lOp ^ | 

questions each day. ■ . , • . ' 

Each pupil in the class of 1971-72 read from three readers: ' They^reid 
orally from a Lippincott reader for five ninutes,. then answered some compre- 
hension questions. Next they read silently for five minutes frpm a GInn 360 , ..^ 



readej: and answered some comprehension questions. Jinally, ttiey read orajly , 
for five minutes from a Bank Street r.eader and afnswered some comprehension 
questions* They received nd instruction as they read ^rorti this latter series* 
The reason .for using the non- instructed reader in triis class and for one 
pupil in the class of 19^^0-71 was to secure materia' for another research, 
study^* The nop- instructed reader served as a control; instruction w&s never 
associated with that reader. Instruction was always focused on another reafder* 
When such a design, is used, if gains are jioted in the instructed feader but 
not in the other, those gains can be attributed wt^ti some confidence to the 

scheduled instructional technique. * - . • 

* • ' , . \ 

Most of the pupils in both classes read^orally, silently and answered 'cpjn- 
prehension questions. Daily data were obtained on all those skills. Itowever, 
for the purpose of this report only the oral reading data are included., 

- : . ■ -■ ^ { 

Achievement Test Procedures ^ ; 

^'For both cVasses two achieven^ent tests were administered in th^ fall. and 

TepSated again in 'the spring. All the pupils were given the Wide Range Achieve 

nwnt'lTeJf.t |(WW\T) and the. ItetropoUt^n. Achievement ^est (MAT). 
* i , . ■ ' 

Slnc^ ihiyte Is only one form of .the WRAT (Jastak/ Bi jo.g and. Jastak, 1965), 

o. ' ' ' ' • , ' . - 

that fopi^'was admloi steipad -\o -a^ the pulpjfs. Seyeral MAT forms are available 
'(MetropbjtWn Achievement Test; 1959, 1961, 1965)^ The pupt.ls In the 1970-71 



class we^e administered eithe^ the pr^Jjjar^prlmary^, elementary or, jnterme- 
diate battery, depending on tKeur abilities^ All the pupils in the 1971-72. 



'class were given th^ intermediate battery. 

F9rvthe class of 1971-72, portio'hs of the MAT were administered twice ^ 
after ,the ppst-test. Or?e weqk after the post- test the word kndwledgc and wdird 



10 * - 



discrimination portions of the test wfere-glven.' These subtests were adminis- 



tered again two weeks later. 



.COMPARATIVE DATA 



The reading performance of the pupils in the two classes was measured in 
fWo ways^ by achievement tests' and by Direct and Daily measurement. Achieve- 
ment tests were used to measu^ performance at the beginniag and the end 'of a 
year. 1ieanwhile,^Direct and Daily measurement was used every day throughout 
the year. - 

!n order tg^compare the tw^ measurement' apjiroaches with respect to place- \ 
ment,lcommuniqation and evaluation, both types of data for three pupils will; 

be presented. • ^ ' \ • 

For the first pupil the two^^asurcment approaches were at odds regarding , 

the gains r'sd? Jn- reading throttghout.a year. According' to one achievement test 

\ ' " H , ' , * • 
he regressed in reading from the beginning to the end of the year. MeaViwhl4e, 

Direct and Daily measure^ient Indicated rather significant Improvement. For 

the second pupil the oppos'lte was • Indicated. According to or?6 achievement test, 

sensational growth was observed. . When Direct and Dally measurement was used, 

, . , , • 

progress was also- Indicated, but the change from beginning to end of the- year 
was far less spectacular. The third case was selected to llJustrate that occa- 

* ' 

sionally the amount of growth reported by both metftiods, achievement tests and 
Direct and Daily measurement, is abo4t the same., ^ 

Paul wasNan 11-year-old boy; When he was given the MAT (Primary Battery) ^ 

and the W.W In^eptember 1970, his reading scores were 1.0 and'2.7. (Throughout 

''--•\ -- - - • e — - 



Case Numberv 1 - Pa ul 
— ^ — ^ , 

2 



< 



n 



Jth?s*report only one',MAT score I s 'gi ven^ That score is the composite of ihe 
several subtest scores/) , When Direct and ^Oally measurement placetent procedures 
were used his best scor-es'were in* theTalo AUo Book 3 (first grade leVel) and 
a B^nk' Street primer. Thus; when pfsfced according to Direct and Dftlly scores,- 
he was placed ia lower, readers^ than he xould have been had 'achffevement test • 
scoresfbeen usecltft* ' ' . ' » , ^ % . . ^ " V 

• *^Mgure 1 shows thfe progress Paul jiiade in ifeadtng from th^ Sank^Streejt^^^ 
seri.es throughout ther yeir ustng Djjrej>€.and Dai ry''n1easurement.y. In September, 
. jfh§n Initially placed in a prfm^r, he sfiowed irbr^^ect rates of about 3Q words 
/.^ per minute andjerror rates of ab^t 2 worcKi^per mlniitre:'' During this time the^ 
^onVf instructional pjt^fe^jfe ip effect for ♦oral reading wa^ a form of^ feedback • 

'm^'^' ^'7 ;| ' ^ - ^ -^^ ^ 

^ ^ ^oc eftors. If he mispronounced or a 

.wo^d- . . ^, ^ ^> 



^ focWror^ If he mispronounced or did not prpn<5unce a wor(^,'he was told that 

.WO^d- ^ _ ^ . . 

^^K^^- : •• 



%\ ' / > " .V. ' 



" , Thel^reader wilt note that after a perf6d of^l^^days- the conditions Were 
^ chang^dl this instructional' change is indicated ori the figure by a vel:t*fc|l 

I line.' ^ISince.,' during the first conMion, his torr^ct rates were hot ImpWvIng 

, . ' ' ... - - . , 

antf his' error rates were cl W^bing sng"htly,i ah lristruotlonaKprocedUrf was 

/ phanged hf schecful Tng a con't i'ngehcy . ToV* eac^^ ten ijiofrecily c^ad words h^ re- 

ceiVed^^^^^^t (10:^h faints Were redeemable 'for minutes of frfee tIme.V 

When the data throughout this phase' we'^s ^t^jdied, a positive i^nfluence on- cor- 

r*ect, rate was indicated.' therefore, during the tht'td ''phase' the ratio was in- 

creased?^ Each point' reciUi^ed 15 cdrrect.ly read words. * throughout this phase 

• 'his corr^bt rate increase a^d hj^ errd^g declined. • ' . .* 
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Throughout, the fourth condition the contingency ^was withdravm. Sufpris- 
5fi9ly». h's, correct rate maintained. Duri^g-.tJ^ condition, Iwwever., his erroi; 
rates, began to increase.'; Therefore, in tbn frftfh conditidn 'a '.contingency was . 
scheduled which was designed to' decrease errors. Throughout this phase if the 
'pupil achieved a correct rate above 50 and an error jat^ ..below- 2, he was Awarded 
pdintj on a^25:J ratio; that Js,,f6r each 25 correctly rejd words he eafned one 

point.' *This proved to he an effective procedure in that his error rate drli^p^ed 

* ' ' ^ : 

and his correct' rate increase'd. ' * ' ' 

* * ' • \ / ' ^ * ^^ ^ * * y 

, IrKthe ^inal condition, the requi remen(j|4hat he read correct IV^aV a, C^te , 
aboye 50 ard make errors at*. a rate 1e?s than 2^ remained in effect.*. The ratio 
of this phase was^extended, \fiowever, so that he now.ha^d to read 3(f corr^ct^ wp^ds 
for each point, throughout this phase his corVect rate remalred about saitie 
as during the preceding phase and his errors f^ll,s1 ightly until the end of ^the 
.term. * ' - •* • ^ ' 

By- studying this boy*s^graph from September to June, the reader will note 
that his correct rates^ improved „from 3 fall median of 29.6 words per mini/te to 
a spring median .of 65/.8 words per m^ute,' -Error rates during this samp period 
d-ianged ,trom 2.0 to K.O words per mi^nute. Thus, correc^and error rates doubled^ 
in improvement from falj tq spring. ' \ . • - '* ' « 

Not or\ly" did Paul read fas4:en,and more accurately as the year progressed,**" 
he read from more difficult material -at the eryi of £he year tf^an in the ^gln^- 

ning. He was initially p^lSced in a 1 reader and by .the end of the y<^ar yas - 

' ' ^ 2 \ ^ ^ ' ' . 

reading from a 2 text. \ * ^ . , ^ ■ ' 

Although made ^obvious progress, as is indicated by the graph, these 
gains were reflectad on only one arphievement test, the MAT. 4. Accord i ng to that 
test, he read at .1.0 level in the faf;! an(i2.'7 in tht spring., The WRAT revealed 



that hie deteriorated throughout the year* On that test he received a scarce of 

> * ' - 

2.7 In the fall and a 2.5 score In tne spring. On the evidence of these data, 
which disclo.sed a 'decay inperformance throughou"^ the year, Paul. might well be <• 
referred to as a non-achiever* >n future years-, if these^achlevecnent 't^s^?• 
. ^scores wefe seriously considered, he might not be expected to learrt any^^ilng. 
If he dtd_ improve "in a future setting,' as he: diid-' thls year, that develbpnieni, 
might be attributed to .a super effort on his f)art» ^ , * * . 

V ^ ; Eve6 though th^ placement Tecommehdation of the MATvfnd the evarMftj^on of 
progresv'iy the 'MAT were similar to the placement recommendation and, evaluation, 
oT*progr4^s when Dl rect' and Dal ly procedures were followed, great- dlscrepancle? 
appear between the two Si^ems when^ It comes* to communfcating the puplf's^ prog- 
ress,> l^tJthls regard. If Mnforma'tfbrf fromjthi MAT wete used^; th^ pupM ^s pa^, , 
r*nts or next *year*'s teacher" could be told only that he had one score In th? ^ 
beginning^f the year artd ahothei^^'score at' th€ end. .'In contrast, when Direct 
and Daily measurement ;l 5 usedj^the parent and '^6ce^vlng ^teacher can be informed 
as to whejt p'rpgress* was^mad^ how much 'was made and to^ what It was at^vlbutedr, 
Th^is latteV infor^fnatlon \^uld *be |»articul'afly informative to his next year, 
teakiher. '''Uot only woul*d- She kiilo«"'whlchi reader to begjn Paul with (assuming she 
was' In'terfested in integrating the teaching 'f rem one year to tfie^oext) ,_but^ she. 
wi^uld knBw'whlch procedures, to u^e in. order ta be mos^t effective^ . 

* 'One* reason for gottig into someidetaj-Uabout. Paul Jsj^ graph has been ta Mlus 

\ ^ ^ /V ' « ^ . • y * 

" trate that progress thr^ghout ^5 year 15 riot a Jways^ steady. Although Paul 

... % J " , . ^ ^ S ' ^ 

galnfed in'evfery respect front ^fall to spring,.. his development was not smooth. 

s ' " *^ 

Throughout, fn4*' yeaVy four Instructional prtpedyres were scheduled, somp.were 
more effecllve thah;otHers. I'S^ ' > * • « 



X .... ^ - - ' 



Case Number wZ.^r John , , ' . * , / 

• jQ>i was nine years o]6.\ In September when the achievement tests were 
51 v^n^Js. score on^the MAT was l.K He s'cored at the. seven ti> mont!h of kinder- 
garten pn the.WRAT. When Direct and Dai )y procedures were used,^hn's best. • 
scores were from reading a lippincott pre-primer.^ In this case'Pffect and 
Daily placement procedures- agreed more with. the WRAT than with tjfe.MAT. 

As to the evaluation of John's reading throughout the Vear^ we will first; 
describe hfs progress using Ofrect ^nd.'Oally njeasurement,, then according to 
the acfilevament tests. During the first three weeks school John's .median . 
correct rate\was 45.0 words per'^mihute with; a median error rate of 1.8\v(0fds 
per minute. His reading rates fluctuated widely f rom o.ne day to the. next:. . 
correct rates ranged from^Zl.O to 100.0 words per mlnu£e, and error r%tes 
ranged from K2 to 9/0 words per minute. : ' . , . ^ < 

• : ^Throughout this Initial period the procedures during th^ oriKreadlng 
•sessions v^ere very simplev- if John was .unabie to^ pronounce a word pr misprq- 
noun.ced a word^ he was to W that word. No additional teaching techniques 6r ' 
reinforcement procedures were. ischeduled. As the- year^prpgr^^se^,? ? *few in- r 
stPictional changes, as was the case with l)|iul ^ were: made along the way. -^These 
' changes were always based on John's data... If his error rates began to Increase 
techniques intended, to improve that aspect^ of performance were scheduled; cor- 
respondihgly, if his correct rate was not increaslngf, -techniques wece arranged 
for that\aspect of performance. t^. • ' . . 

By the end of the ye^r John was reading from a 2' Lippincott book. '^]<^^^ 
median correct and error rates were 75.0 and 2.2 word^ per minute. Ati^tj\is . 
lime his dally performances were much more stable than during the first part of 
the year* ^ ^ 



When it pomes to evaluating progress us^ing Direct and Daily meaiurenfent, 
John's correct rate nearly doubled from beginning to end of the y^ar, his er^ror 
rate went up slightly., and he moved from a primer to a 2 text* When achieve- 
ment tests were used'^to evaljiate progress throughout the year, a 2.9 gr^de level 

increase was noted by the MAT; and an eight-yeaV Increase was Indicated by the 

* * * 

The remarkable Improvernent reflected 8y the WRAT was .probably due to the 

phonics approach used with John throughout the year. Since he read .from a 

' - ' > ' I. ^ 

phonics reader and one of the Instructional techniques used during the year was 

phonics drills, John became- adept'.'at decoding words. And ^^nce the reading 

evaluation on the-WRAT simply requires thei pupil to say Isolated words and he 

was able to say thfem within the time limit on the test, Johh was able .to pro.- 

no*un"ce many ditficult words. * 

Thi^' possible explanation for hfs Irtpressive growth on the V/RAT Is offered 

to illustrate what can happen when Mndi rect measurement is used.. Since John s 



teacher wanted him to read in context from a reader and wa^ not particularly 
concerned about his ability to say Isolated words, a more accurate assessment 
of this skn\ was provided as he read material from Lipplncott texts than from 
Identifying a serines of unrelated words. ^ s , 

In regard to the reporting of John* s progress to his pa'ren^s or to a re- 
ceiving teacher when either system Is used, the same points discussed for Paul 
are ar?^ln applicable. That is, if Direct and Dally measurement is used, the * 
people who receive the information can be told about correct and error rate 
changes across tline and about advancement through readers. In this case a pre- 
•pr.irtier to a 2 text. Further, the receiving, teacher can be.tol^ which instruc- 
tlonal techniques werie effective and which ones. were not. She will not have 



to begin the",v^ar searching for effective Instryttlonal techniques/ 
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If a receiving teacher used the- previous spring's WRAT score for John s 
placement, the consequences , to his future development could be dtsas^trous. It 
he was placed at the beginning of the year* in an 8.7 reader, .the protability 
is, great that he would fail miserably* If this happened he could be sent to a ' 
psychplogis-t or; other djagnost ician. Tbey could be requested to explain the , 

reason for the huge discrepancy between his current classroom performance and - 

' ' 1) . / . " 

his last spring's achievement test score. Many hypotheses for thi^s disparity 

0 ^ J, ' ^ ' _ , , " 

could be advanced: a stressful schooTsltuation, uncooperative parents, poor 

' • ^ ' ' \ , , 

.reading method, inappropriate material; lack of motivation.* John could be 

labeled an underachiever. ^There is a great chance he would never reach the. 

p^innacle of that one day in May when he .scored so well on the WRAT.' With such ' 

a label John could spend more time in the waiting jooms of diagnosticiao^ .than 

actually being helped to read. * . ~ . . j j 

Case Number 3 * Jitti ' / 
J, Ji m was t en Wears .oLd.,_,_WheD-JA'e-ach.i-evemeftt^^ a d min ist ete^cLiii 



the fall, he scored at the 2;2 level on the WRAT and 3-0 level on the MAT 
(Table 2). When Direct and Daily procedures were used, his best scores were 

obtained when he read from a primer. In .re/erence to pl^cfement neither Ichfeve 

* /- ' ' 

ment test agreed^with Direct and Daily nieasurement.. Had he'been placed accord- 

^, . * / - . 

ing to an achievement tes£, he would have begun m material two or. three years 

/ , ^ <^ / . . * ' 

beyond hi,s actual abilities. * ' ^ / 

^' ' ''^ , * ' ^ / 

- Figure 2 is provided to display Jim*s achievement as me^^sured by Direct 

* . * " _ . / - • ' ' ' 

and Daily prX)cedures thro^ghout the year. At the beginnin^of the year Jim 

read from a primer (Llppincott Book B) , and hy the end of the year he was r^ad- 

ing^from a, l^ (Book D) book. During .the first few weeks of school his correct 



and error nate medians were 23.8 and k.^ words per minute. • By the end of the. 
• ,year those rates were 63*0 and 3»5 words^ per minute. 



. • • t FIGURE Z ABOUT HERE 

JFm's year of reading consisted of seven condition's.. During the first^coh- 
di-tFon, a baseline/ the instpuctjonal procedures were the same as those used, 
with Paul and JoKn. If he -could not pronounce .a woxd^or .mUp-Conounced a .word > 
he was toJd that word. Throughout Condition 2, he was required to .rehearse his. 

. errors. As. he read, the teacher rioted each error word. Foil qwing "each reading 

" ' * ' ; 

sessionohe was drilled on those words for ten minutes. 

" , ' o .... • ^ 

Condition 3 was a return to baseline conditions. Throughout the fourth 

condUion the pupil read the story orally before he again read it orally.*^ The 

first reading was the practice period; he was stopped per iod leal Iv^^^ and-.coached - 

on, certain troublesome words* When he read the second time, the conditions 

-"were-lti<e those-dur4fig jthe baseline. -The dat^-from the second readings were 

' \ V ' ' ' 

gr^iphed. ; i. * . I " 

Throughout the fifth condition no instruction was .scheduled* ^The condl- 

tions were like previous baselines. During the, next condition oral pre-rea-iing 

was again ^Instituted. The final condition was a return to baseline conditions 

for the fourth time. 



\s Jim's progress, like that of the other boys, was not smooth throughout the* 

^ - »• * . "* , » ^ 

year. His correct and errors rates were variously responsive to the Instruc- 

tional techniques that were Osed. As Is apparent in tt^e. graph, his correct • ^ 

rates did not steadily Increase from.beg Inning to ena of the study. Nelthe^ 
did his error rates steadily decrease* , f 
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The d|ta throughout the year indicate how one instructional technique can 

be compared with another* During the first thre6 conditions, the error xlriH 

* 

procedure was assessed. The effects of .that technique can be determined by com- 
paring the data from the second condition when, the intervention was jjsed, 
'"the data, from the. first and thi rd , phases , when' the intervention was'not used* 
As the^'graph indicates, his best performance, in^ respect. to correct and err6r 
' rates, was* during the third phase wh^if no ^error instruction was used. This • 
might seem to indicate that Jim would have progressed in spite of. the error 
drill. cAn alternate explanation might be that error drill' facilitated change 
*jn the second phase ^ t^jen, when the intervention wa^ removed, Jim, had progrespd 
to the* point where oth^r >>ariables continiied to influence, hisf read itig, ^ 

Throughout Condition? 3 through'T the. second techiyique, oral pre-reading> 
w,as ev^luateid- The^effects of this technique can te ascertained i f the condi- 
tions, where pre-;»reading was used are compared to adjacent conditions where it 
was not scheduled. That is. Condition should be compared with Conditions 3 
and 5, and Condition 6 should be compa/eti Vith Comjjf ions *5 and 7. • 

When correct rate comparison's ai;e made, Jt is obvious, that reading (Jer- 
formance Kere« v^as significantly jjetter , during pre-reading ci ccUiHstanc^s, Con- 
ditions k and 6. Correct rate^, during, pre- reading ^con.di t iorjs , were about 50% 
higher^lhdn durtng conditions when pre- read i ng was not scheduled* ' . 

Such a. clear-cut advantage-was not apparent "for error rates whfen compared. 

across conditions* However, during the final four* conditions the error rate 

• ♦ ' 

' . r " 

medians were lowest in the two phases where the pre-reading technique was used. 

When the effectiveness of the* two techn iques--error drill and pre- neadi ng-- 

> is compared,, there is little doubt as to the winner^ Clearly, for Jim, oral ,^ 

» ' »• « 

pr^- reading was a much more /influential technique than error drill. 



.A ' ; * . \ • , /.^ 

, '*Wheij 'jim*s progress was evaluated according to the ^acfiievement tests, the 

^ ^^AT Indicated a l'-3' year ;^in, and the WRAT, fe^ain of K5 y^ars- These gain$^ 

^ were about the*' same -as thj^e rAvealed' by' Oi re'ct and Daily measurement, which, 

- -illustrated' a change of about a yea^ and on6-half. tt must oe pointed out, 

' ."'^^-^ - \ \ . ' , A ' 

however 4hat although, all measurer^greed as to the. amoupt of ch^ge, that . . : 
change occurred at differer^t-Mevels-^AccoTding to'the MAT, .moved from. 2/2 

' • to 3»5-. The 'WRAT reported cjiange from 3^0 to '♦•S- His actaal ^jrogress,- accord- 

» .'^ " y • ^ ^ " ^ ^ ' 2 

> ing tci Direct anb DaltY'"^^^M''®)!^"t, was from a primeY to a" I reader. 

' \ ' . -As to, the type of'- information fr9m elxjJ^r system that could be conveyed' to. 

. ' .another person; the ?ame features discusked fni^the previous cases are evident- \ 
Jim's pirents arrd'his next year's teacfier colild be*told about hl'S/correct ahd 
error' rjUs ^n"d which readers had been^ dove red. . His' next year's teacher coUW, 

- ,/be informed with great confidence that or^l pre-reading Is an effective tech- , ^ 

' - * hii}ue /for^'^'jp. ^ 7 • ^ ' < . > . j 



' pliSCUSSION ' ' 



We haver-in* thls^paper, attempted to lUustrcfte how the data obtained ^from 



. .achievement tefsts and^^those obtatJied from Oi.rect and Daily measurement:, di.ffer* 

- ' • • ^ . , % , , A ' ^ ^ ^ ' ' ^ 

*• vie ha^'discussed dfft^rentes jn regard ^to three f.unctions: placement, e^valua- 
tiofi, and comrtuni<;at ^on^ In ofdec td r^how dif fel^enceS"* betweefr the 'twQ systems 
^ we used three ca^es, ^Ich Kllustrating certain disparities between the :two. 



^vsy^litems. 'Over a period c^f: two Vears we comfit red' the two approaches with 13 

^ - 's .. ^ ' - ^ ^ . ^ * ' ^ . ' • . 

•'^pupils. The datafrom those pupils indicated the same discrepancies discussed 

* / ' • r . ■ >' ^ ^ / 

, . ins this report ahd others: . . < . ' i: ■ ' ^ 

.y -. ^ . ^ . > 

We wouVd like to sulrmairli:^ severpl-^] fferentes between the two systems 
■ '-.that w^re not discus^d earli.er. First (and this is a wi th in-system comment), 

' . % ' . ■ ' / . ' • >' > ^ " 
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the two achle/eWnt tests dicfenot agree. When the fall test;s w.ere compared, 
the WRAf score was higher 10 of 13 times. When the spring scores were compared, 
the WRAT scores were higher. 3 of 13 times. • ^v. ' ' ' f 

When the higher achievement test s.:ore In the fall was^ compared to Direct* 
arvd Daily . measurement- as related to place(^ient, children woul.d have been placed 
higher 13 of 13 times ha<f the achi dement test store been used. Had -the lower- 
score in the falT been "useTi-folvplacem^ 'have been placed ' t- 

'too highio of ii t iines. The Di rect and. "Dli ly sVst,em c 1 earl y~fn^ca ted - the " - ■ 
children were-unable tc read at those higherr levels . y 

■ "When gain scores from fall to spring were compared i?etween the , two achieve- 
ment tests, children gained more accor*li,ng tp the WRAT 6 of 13 times, and more- 
.according to the MAT 6. of ,13 times (one tie was noted). As to. amount of gain, 
the two agreed within one-half year of each other only 6' of T3 times". 

Wh^n gains "according to Direct and Daily tivaasurement were compared to ^hose 
indicated by achievement testa, "oi rect and Daily ^co^es^ agreed wi'thin sj x "gths 
with both the MAT and WRAT 4 of 13 times: When these comparisons were made,' 
LIppincott data were used from the 1.971-72 class and the starred reader in the 
class of 1970-71. These were the readers used .=or oral reading instruction. 
' It must be poinVed out-that although these gain scores were the' same about 
one-third of the'time, gains' were often noted at di fferent, levels. As was evi- 
• dent with jtm, although £he two systems reported s imi lar. amounts of growth ,\ that 
change occurred at .different lev.?ls.. This type of discrepancy was noted ,iiio re 
often between' the WRAT and Direct and Daily measurement than when the MAT and ^ 
Direct and Dail^" prodedures were compared". ' ' . 

In regard to placement and evaluation, the MAT agreed more closply>/ith ; 
Direct anrf Daily measurement than dld'^he WRAT. Relatively, ^hen, the MAT , 
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comfX)sUe sco^re was more dirfectly relatpd.to the oral reading achiev^fmertt of the 
pupils In thj^s report than wap the .WRAT score. " ' 

• In addition to the. lssur:of directness, we were also concerned with fre- 
<)uency of measurement, so an achievement' test was given repeatedly. .As explaljted 
In the procedures se.ctlon, subtests of the MAt were given three times at the end 
of the year. > (These additional two tests were given to sl^x boys.) Jhese data 
revealed rather Interesting findings.^ First, when the three woN-kna^'ledge • 

.SCO res:.werc compared^^we Jo.und. JtMt Lxhe^secoM. J5^ ^ 
flrs(,« 27t>f.6 times; b) the third ^core was higher than the second, 2 of times; 
c) the third score was. higher thaA the first, 2 df 6 times;, and d) the varlabll- 
t ty' from first to I'ast score ranged from -;7 to .5 of a year. Second, when the^ 
word-dlscrlmfnat ion Svore§ were comparejd, we found that: a) the second score 
was higher than, £he first, 3 of 6^t'lme5;\ b) the third score was higher than the 
second, I of 6 times; c) the th4rd sco^-e was higher than , the first, 3 of 6 times; 
^andd)- the varlablUty .from first to . last s.core ranged from -.8 to 

. .This analysi^ pf the word- knowledge and word^dlscrlmJnatlon scores point 

• , ^ • ' , \ 

out that, ^ontr%ry to the views pf .some^ who warned that scorect WbuTd; H'^e ^ie^^^^ 

^' . ' . ^ ■ " 

of. repeated exposures to^the te^t, scores did not always increase from first to 

* * * . ' 

f:hir-<j »test.v More itpportantly, confronted by th^ wide variability o^-scores on 

' • . *- * , ' ' 

^both tasks, the Interpreter of any. ope^ test* score should be extremely cautious 

wherj statiiriVthat ~a single^^score reflec/ts true performance ofl^chlld. ^ 

\ Although thls.p§pfer |^ no^ Inteflded as a. technological treatise on how to 

use Direct and Daily measurement^^ such/a measurerwjnt system is not difficult to 

explain or use. .First', the teacher shbuld identify whjt_slie_JwJshes to teach (in 

this case oral reading) , ^b^n define^ that behayior as to correctness and Incor- 
* . « * . 

.rectness In orcfpr that .both may be counted., Second, a situation musf be arranged 
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SO that the pupil, can respond. The many environmental occurrences and circum- 
stances during these sessions should be consistently arranged. Third*, correct 
and error rate data should be graphed each day. The teacher should then, of ( 
course, study these data in order tjojetertnfne whether^r not the child is prog- 
resstng. Fourth, if progress is not occurring, something should be changed; a 
different instructional variable must be scheduled. The evaluator of the 1*ata 
should then continue to monitor the effects of the intervention. * . 

This last point brTng^'out a fourth advantage of Direct and O^fly measure- 

ment over the achievement test method. In addltlonito bejngayalid' and reTia- 

- ^ i , ' 

ble measurement system In regard to placemej^'t, evaluation and communication, the 
instrMCtional process Is more vividly brought into, focus under Direct and Dally 
procedures. WKen. this approach to measurement is used, anS when the teachejr 
scrutinizes' the data each day,* s<^e. is informed continually about the pupil's 
success or failure. As Is explained In the preceding paragraph. If the current 
instructional procedure is not effective, a change can quickly be Tjade. In con- 
trast, achievement tests ; can neve reserve such a functloni Were they used to 
prompt instructional change, the teacheo would be ab4e to switch j^i^ocedjures only 
in September *and May. 

In this paper we have reported on only oral reading data. As Indicated in 
the paper, we also kept data'^.on.^sJJent read liig and on various comprehension 
skills. Oral reading data were presented to make a point of comparisons. Data 
in regard to the other reading behaviors would have- i^ade the same point, that 
Direct and Daily measurement and achievement tests do Indeed furnish different^ 
views of read i ng development* . , ' - • 

Many teachers of reading would a^gue that reading is mo/e than oral reading 
more than oral and silent reading and answering comprehension questions. We 
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woyfti agree; howevpr, we triaintain that the three behaviors. cited ar^, for devel- 
oping readers, important elements .of the reading process. ^ ' * )^ - 

But whatever the reading sKIll, if itjs defined If C3n be measuted *af\d 
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graphed. If this can be done it can possibly be improved. So whatever the |ead- ^ ^ 
Jng behavior, be ft writing resumes of stories^ lot^griating currently read^mate^ 
J rial with past stbrles/ defining Vprds or writing Literary crlti.cisn), th'fe Direct 
gnd Daily* system is appropriate. Because. of the advantages advanced -In this 
paper, it Is certainly a more suitable syste'firthanrthe use of achievement t.e$>^s. < ' 
' . The reasons for using Direct e^nd. Dally measurement rather thin achievement 
tests should^ be* carefully considered, foxJlhe future developmerxt of individuals^ 
i's^at stake.' Two potential^ misuses of ♦achievement tests haveM>een discussed ' \ • 
^ h^re. In PauK^s case, had only achTeveijient test scores been serloVisly coflsid-^ » 

ered, he migjit^v^wel 1 have beferi labeled an overa^hleyer or perhaps a.nonach lever. ' ; ^ 
The consequences, if the latter* label peTtslsted, would, be. Jthat te^achers might 
not attempt, to teach him. * If this ,happeryfK|*h§ would qui-t^^ rkely' befcome more . - 
and more^discrepant from h1-s p^ers.* , *. / ' , o- 

In John's case, .if achievement tests alone were considered-, he might have . 
been given anotHer-label arf.underachiever. Such a label. If It stuck, cou^d. 
result in' a great deal, of mental anguishi. If he were over-placed In subsequent 
years and could not produce, his teachers might continual 1^ harp at him and his 
parents about how they- knew he could achieve if he just tried. These are but 
two examples of the misuse of achievement * test scores. Thei^e ate many others. 

Direct and Dally measurement does nat' result in a label. Even if a child 
was galled ari bj. 9-2.5 (his correct and error rate in redding for a day), these 
' ' scores would change (hopefully for the better) the next day.' Direct and Daily 



ERIC . I ^ r 'm: 



measurement is by definition a dynamic system that r'eports growth^ unl ike the 

■ H ■ ' . .. - - ' u ^• 

achievement t^t- system that' provides an indirectly relevant score that is a 

statjc misrepresentation of progress-, - 

Obviously, our recommendation to reading teachers^ in New Yorlc City and el 
where is that they use Direct ancj, Daily measurement^. I. sympathize with Mr. 
LaFontaine who so eloquently condemns achievement tests, and. \ agree with Ms. 
Strang, who has contended t;hat more time should be spent ,^n teaching than in 
developing achievement t&sts. ' , . 

^Although ^achievement .tests have for decides been, acclaimed as the yard- 

. ' \^*^ , ' • ^ . ' ^ 

sticks, by which^to measure educational progress, recTervt -critlcisra has led to a 
breach pf the once-imp/egnable system. If the reader will tolerate one, last 
bow to Hamlet 'w/ will fet our- noble pHnce pronouncel^tlie^Jinal obsequies to 
achievement tesVr and hail ^feir replacement, Direct and Daily measurement. , 



AlasV-Poor achievement testsp I .knew them/ * ' - 
WRftT and MAT: -fellows of infinite jest, ' 
of most skil Ifur delusion: they have ^' ^, , 

borne eva1uatjj[r:s-on their backs for decades; ' 
and nov^, how eagerly in my imaginatipn/ . ^ 

it isl- My hope, rises at it. He,re,* hung ' ' ; 
on thbse bannisters^ of schoolrooms thai ' ^ 

I have so oft seen, are strung the y^ithered - 
test+ng kits. .Where be\your stanines ^now? 
your subtests? your administrator's guides? , 
your indirect attempts to eval uate, that were 
wont Ko report pupil gain? your Infrequent assays, 
'of'pupij progress? Now the multitude mocks your 
simplistic and fraudulent measurement attempts. ^ 
Now get you into the principalis trasj>, and lie^there, 
let him* dump other waste ort your sheets, to this 
end you will come.^ But none too soon, for countless 
souls have been misrepresented. Prithee, you 
measurers of skills, tell me one thing--that you 
will forevermore use the Direct and Daily form. 
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F INSURE CAPTIONS 



Fiqure 1: Direct and Daily measarement of words 'read orally throughout the , 

^ ^ ' ^ -x r 

1976-71 year for Paul. Separations -in the data points ind4cal^' abs^cfes, . * . 
weekends or* vacations • The five vertical lines indicate when diW^rent. - * 
^Instructional 'procedures were in effect. The circled numerals below the^^- 
y^corr-ect rate plots* are the median correct rates for each pHasi; ^t•ha ■ 
inerals in the triangles are median error rates. TWo median^ ^'^.r^/rlgi^re.l^^ ^ <w 
for conditiofTS which' included vacation periods. The-^numbers aiong the:top y 
of the graph indicate which Bank Street readers^were 6ei>ng' Useti*. 

Figure 2 : Correct and error rate data throughout *the school ^paif for *im^ . -j^- > 
Correct rate medians vfor eachT condition are enclosed ii^circles; error 
. .rate mediar4 are enclosed in. triangles. The *six vertical lines separate 



the seven conditions of the year. The Lipplncott readers us'ed throughout 
the year are indicated along the top of the graph. 
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• THE RELATIONSHIP BETWEEN QUESTION TYPE 
AND MODE OF READING ON THE ABILITY^ TO COMPREHEND 



K 0 



Cheryl L. Hansfen and Tliomas Cl Lovftt 
^ University of Washington 
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Ac.^y6ar long study of- or'ai reading and cbmprehensfon was conducted with a 



class of seven h$ys aged 9 - \% who hall been labeled learning disabjed^, Thi.s 
report deals vfith two. aspects? of that study: A) the relative perfoi-Wance .of ° 
^'^ tbe pu'pi/s on three^'types of cop^pfe hens ion questions (recall,, s^ejjuence, and 
InterpretaHoa),'. and b) the relationstMP betwfen tnode^of reading (oral or st-^ ^ 
: lent) and 'SbiUty tb.,conipr^hend. , . o - ;» ' o . . » 

Three f J^ndlng^ ,re,levant ^o' types of comprehension cflie&tlons ii-e reported: 
^, 0 a) .comprehension abjUty was .highest, on jjecall quesUons"ati<^ I owes ^ on .Inter- . 
• pretaf^on 'q}i"esVons'r%) the abilTty to comprehend alV types" of questions, reproved 
■ during the yiar.'this improvement varied type of question; and c) one instruc- 

' . y o ^ ■ • , • , '7 

..^ tional technique (cfBrrfection of . comprehension errors) resiil|^ed ^rr. Imp roved per- 

o.form^nte onfall types of comprehenslon^^questions. ' ? 

Tv/o findings relevant to-the 'relationship of mode of reading an(^ ability to 

' comprehend are reported-, a) pupils' abilities to comprehend were Influenced by 

mode.pf reading;' comprehension^perfprmance was^alwafys higher whein material was^"* 

read orally, and'b) the abllity^'to comprehend material read both orally and 

° sil'ent-ly Improved during the year". The disparity between comprehension per- -> 
- ■ o \' ■' . ^ • • . " 

/4ormance from" one mode .tto- , the other remained 'undhanged fr^m blglnnln^ to fend of 

' the year. - ' -^v^ . . . ' ^ 



• THE REbATfONSHJP 3ETWEEN QUEstlON TYPE 

AND HODi OF READING ON THE ABILITY-TO COMPREHEND ' 

* Cheryl t. Hansen^apd Thomas C. Lovitt 



? . , • ^ University of Washington * 

.. . Ourlng't-he 1972-197? school /ear, we conducted a study designs^ to explore- ^ 
eertaJji relationships batweeh oral and silent reading arid the ability to compre- 
■ hend. ftore speci f leal ly^we had'^four aims: a) to' stud^y the relationship 'between 

^ora)- reading and its comprehension; b) to study the direct effects of^an Jnter- 

-i ' 

ventlon on oral reading; and the direct effects of .an Intervention on the compre*- 

* . ^ • . ^ •• ; 

hension^of orally read material; c) to study the Indirect effects of an Inter--' 

vetition, on oral reatftfTg" and the comprehension of orally read material .when .the 

/ intervention waV^scheduled for the ^It^rnate behavior; and d) to determine whether 

• ' ^ Silent rei^ding snjd the cpmprchension of s lentl^ read material would be, influx 

/ enc;sd by I'nteVventions scheduled for oral reading and Its iprehension. 

In or"der to obtain data relevant to these questions, our class of seven 

boys was divided -into two "groups.'" Daily record^^were l<ept on the rate of oral 

. • , •) ■ ' ' i 

:' a'nd sil^pnt reading, and tiie-percent-^'corrfectly answer^ comprehension questions 

/or both, types, of reading* Throughout the-^yeanTlnterventlons were alternately ^ 

, focused on either oral re^din^ or the comprehension of orally read material. • ; 

Interventions were never, arranged for silent reading or Its comprehension. 

The design of the stiidy Is presented in Figure 1. Throughout" the year 

thefe were' nine,phase5. -During the baseline phase, no Intervention Was arranged 

for "Either grbup. During the second phase . an intervent ion ^for oral readitig was 

arrangied for group I, and for the comprehension of orally rfead material for 

group 2. As Indicated by the figure, the i/iterventions were alternated thw)ugh- ^ 

out the year for the two. groups. ^ 

^'^'^^i.^^ — — - — — ^ , * 

* ' ' ' . , 'insert Figure 1 Abou; Here • . 
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The Interyenticin tecfinlque u&ed for oral reading and its comprehension was 
kbout the same. When the technique was associated vJith oral reading the stu'dents 
were required to pronounce correctly all the vyords they had* incorrectly pronounced 
during the oral r§.a,ding session. When the techniqife was scheduled for comprehen- 
sion, the pupils were asked to refer to the book aiid correctly answer each com- 
prehension question that was Initially answered incorrectly. Three major findings 

were reported from this study. Onb, the'^greatest performance changes were noted 

/ . " ' .t 

- skills in*which'the intervention was directly focused. For insf^nce, when the 
it. .ervent ion.was scheduled for the comprehension of orally read material, per- 
formance oh that ski 11. improved more than performance., in oral reading. A second 

finding was that when the intervention was directed tov^ard ^jtiier oral rqadiiig^jr 

» . ' ^ i* > ^ . 

Its comprehension, positive changes* were noted on all' other measures.;;, A third 
finding was that when fjerformance- i ncj?eases on all measured behaviors werje stud- 
ied, as a function pf eithe\ intefvention, -tfie gains v^re more pervasive when the 
intervention was scheduled for the comprehension of orally read material (Hansen ^ 
6 Lovitt, 1973)^ ; 

In this rQport we will discuss tv^o other findings from that study: a) the 

- ' ' ' ^ ' \ ' \ ' 

relative performance of the pupils on three types of comprehens ion quest ions , 

and b) the relationship between the abiUtytc comprehend material read orally 
and material read silently. , . 

. The relative difficulty of Various typ'^s of comprehe^ion questions before 
training has been the subject of a few inveotigations. Feinman (1^72) reported 
that second'and third grade students were more able to comprehend literal com- 
prehension (questions than inferential questions, Davis (1 969)' reported a similar 
flnd^jng with students in the middle grades.. In two other studies (Bickley, 
Weaver, & Ford, 1S63; Rystrom, I976) it Was 'Reported that- factual questions were 
^ea^ler to answer than other types of questions. 



'The effects of incentives on factual and inferred questions were invest!- ^ 
*• . • * * 

gated by T raze, (1971).' His results indicated that incentives positively in- 
fluenced comprehension performance and concluded that, factual questions wer^ 
nxjre easily answered than inferential questions. • ' , 

All those studies dealtwith the ability to' comprehend before training. 
We were dnable to locate any research .that deal t wUh the effects of some train: , . 
ing })rocedures on the ability to answer various types of comprehension ^uestiorts. , 

Although oral vs. silent- reading has been discussed for mony years at the.^ 
primary school level, the relationship between mode of reading and the compre- 
hension of material Yead by either mode has apparently not been Investigated. 
Two studies, using adults as subjects," investigated the relationship between ^ 
oral and si.^lent; readirtg and the comprehension of quest ipns from both modes. 
These studies concluded that adults exhibited better comprehension abilities 
from silently r&ad m^terlat' .(Poul ton fe Brof/n, W?; Weaver, Holmes, '& Reynolds, 
'970). : • • • . . . . • 



METHOD 



( Subjects and Setting 

This study was conducted with seven learning disabled boys, ages 9 -.i2. 

J. 

At the time of referral all the students weresserfoVmlng between one and three 
years b("QW their peers in reading, spelling, and arlthmetfc. The. boys lived 
in upper middle cfass homes in the suburb of a'large metropolitan area-, and ^ 
were of average intelligence. ' 

The"project took place in th? Curriculum Research Classr.ooiii at: the Experl-; 
mental Education Unit,, University of Washington. The students were placed in 
this class for one year of retnedial Instruction. ' • ' , 
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tiaterials ' . ^ ^ ' 

Two basal reading series were used In^this projects Lipplncott Basic 
Reading (McC'racken & V/^alcutt, !970), and GInn 36O (Clymer, 1969), Levels 2-1 
to 3-1. .Each book was divided Into 500-word segments' (excluding plays ar>d ^ 

poetrV):. J / . 

Three type^ of comprehension questions' were Identified from each ^6ok: 
recall, sequence, and Interpretation. A recall 1 question dealt with facts given 

r 

in the story, for example, "Who lived under the^ bridge?" Sequence questions 

» . ' ' • 
were like the. following, *'After the goat got over the bridge, what did he do? 

Interpretation, questions required many different skills Including translat loh,^ 

inference, and synthesis. An example question was, "Why did the troll keep 

• * ' '* 

letting hin^self get tricked?" ^ * . ' ' 

Thirty comprehension questions per each 500-word segment were written (or 
•» » " . * 
three per 50 words). "These Included 10 recall, 10 sequence, .and 10 Interpre- 

tatlo« questions. 

The students were required to answer ^these questions with brief, written 
statements. Each- answer was counted as either c6rrect or incorrect. If the. 
student, wrote an' answer to a recall or sequence question which differed from 
that expected, but was equally pertinent to the story, It was counted as corrects 
The criteria foj. accept abi 11 ty of interpretation responses was that they be 

logical and sVfted for the question. An interpretation response was counted 

\ ' ^ 

as incorreict if the student ansy/ered with a generality such as, "Because He 

wanted tp," or "Because he liked him." 

^ ^ ' ' • . ' ^ 

rProicediajW^ ^ - 

Every -day during. the school year, the students were required to read 1,000 
woi-ds from ihe tv/o basal serle$ and answer 60 comprehensTon questions. The 



students read orally in one series and silently in the other. The- order of 
• reading silently and.orally varied each day. Oral reading was conducted Indiv- 
idually In a small- room off the main cla^room. The boys read silentfiy and 
responded to both types of comprehension questions at their desks. Comprehen- 
sion questions were answered immediately after eajch reading session. 

The students were allowed t6 ask for helpMn pronouncing unfamiUar words 
as tfSey answered comprehens ibn questions and read, silently. The' teacher also 
provided assistance in pronouncing unfamiliar words and corrected the. reading 
errors'of the children durinj'oral reading sessions./'Cfai ly records for each 
Student were maintained on the rate of oral and si lent reading, and percent of 
correctly answered comprejiension questions. 



Intervention 



Similar interventions were designed for both oral reading and the compre- 
hension of orally read material. Interventions were never' scheduled for silent 
reading or answering comprehension 'quest ions following silent reading. ^ 

When the intervention was scheduled for oral reading the student was re-"" 
quired to practice phrases composed of the reading errors-he had committed ' 
during the pral reading session, if he did not equ^l or exceed a predetermined 

3 

rate of reading. The student practiced all the phrases until he could correctly 
read them to the teacher. These error word phrases were written on a sheet cf 
notebook paper. ~ • — 

When the intervention v/as associated with the comprehension of orally read 
material, the student was requ i red- to correct each incorrectly answered compre- 
hension question if his comprehension sc<^ did not meet or exceed a predeter- 
mined rate. The student was allowed to refer to the book as he corrected his 
work, and could discuss his answers with the teacher. 
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The desirsd rates for oral reading and comprehension were based on each 

pupil's median performance ^cores during the pho^se preceeding the intervention. 

The desired rates increased slightly each day until maximum levels of perform- 
♦ 

anqe were reached: JOO correct orally read words per minute and k correctly 
answered questions per minute* Desi/red^ rates were not established for Incorrect 
orally re^d words'. Each intervention was Jn effect tv^fice for all students 
(refer to Figure 1)/ for approximately four weeks duration ^per condition. 

f ff 

Rel iabi 1 i ty ^ 

■ Agreement in, scoring the answers to comprehension questions was determined 
by a second teacher who checked 1/3 of each • student's answers. Reliability was 
calculated by dividing the number of agreements of the two teachers by tKe num- 
her of agreements plus disagreements, multlpljed by 100. The average relia- 
bility for^scoring comprehension answers was' 99*1^. Re.liabllity for scoring 
each- type of comprehension answer wasx qui te high:,- recall, 99^; sequence, SB%; 
and interpretation, 37%* ' - < 

,Rel lability for calculating words read incorrectly during oral reading was 
det;erm(ned once weekly for' each student by tape recording those sessions. A 
second teacher listened to these recordings and counted read i ng" errors. Using 
the same formula for calculating the comprehension reliability, the average 
error rate reliability was 96. the average correct rate reliability was even 
higher. 

■. • ■ ■ 

RESULTS 

Comparing Performance Related to Types of Questions 

In order to compare the performance changes of the pupils from the begin- 
ning to the end of the study for the three types of comprehension questions, 



each pupil's score for answering questions from orally read material during 

* Phase 1 was compared with his combined scores of Phases 8 and '9. Pha^s S^and - 

9 were combined' to equalize the'^^^ei'fects of the last two- Interventions across 

subjects. Table 1 shows the average percent correct and range of the .pupils 

for each type of fcomprehension question during Phase 1 an^ Phases^S and % the 

difference scores between? the two periods and percent change throughout .the year. 
* t • 



Insert Table 1 A^ouc Here 



During Phase 1, the average correct percent comprehension Score for the 
group was Ttfe highest level of comprehension performance .for all students 

was in answering recall, questions, average 68%. Interpretation questions were 
.the most difficult to answer, average 48%. The average comprehension score for 
sequence questions was 55^^ ^ 

. The overall correct percent comprehension score for the group improved 
during the school year, from 57% tcy73%. Each student's score for all types of 
questions improved; Viowever, the relationship between different types of com- 
prehensio'n questions 'remained essentially unchanged. The scores for recall 
questions remained highest for six students, averaging 81%. The loWest. average 
comprehension score wos for interpretation questions, 66%. The average, fori 
answering sequence questions was 71%. ' , 

The amount of change for each typ'' of comprehepsloh question varied by 
student. The greatest improvement for three students was in answering inter- 
pretation questions. Two .students gained the most. In answering sequence ques- 
tions, while the remaining two students improved most in responding to recall- 
questions. In'general, recall questions were l?ss amenable to change than 
either sequence Or interpretation questions. The percent change for recall 
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questions between Phase 1 and Phases ,8 and 9 averaged ]S%. The percent 'change 
for answering sequence questions was 2S%, and for interpretation questions, 38%. 

■» . • * ' ' ^ ' ; , i' 

Comparing Modes of Reading . * * . 

Ability to comprehend was compared as: a functJx^n of two modes of readings- 
oral and silent. Table 2 Indicates the group mean and individual ranges for 
aoswerihg comprehension questions from orafly and silently r-ead matei*^al^ at the 
beginning (Phase l).and end (Phases 8 and 9) of the school year. 



Insert Table 2 About Here 

7"""' ' V' > 

The average ability to comprehend orally read material was higher than the i 
comprehens'ion performance of' silently read material dui-ipg Phase 1. The average 
'score for comprehending orally read marterla^ was 57?; (range k3% to 61?). The. 
average score for answering. si lently read mater/ai w.7s kZ% (range 38% to (>]%). 
During Phase 1, the difference in answering' comprehension qufestions from the - - 
two mod^s averaged 3%. Six students had higher comprehension scores after read- 
1ng orally, while one student had the same ijevel of cpmprehension performance 
for both modes of read.ing. The individual range of differences, between mean 
oral and silenf reading comprehension scores was zero to 1?!^. 
*" Air'students improved in answer ing -both oral and silent readJng comprehen- 
■? sfon questions during the year. ' The average improvement, for answering oral 
reading questions was \6% (range S% to 33%): from a Phase 1 average of 07% to 
a Phase 8 and 9 average of 73%. Improvement for answering silently read ques- 
tibns averaged 1?% (range 5% to'38%). from an average of m correct durjng 
Phase 1 to an average of 65% during Phases 8 and 9. All students exhibited 
higher oral • i-eadl/ig iompreheiis Ion scores than silent reading comprehension 
scores at the end of the year. The average difference was S%' (range 2% to 12%). 

/ 

/ 
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Percent chan-^e between Phase 1 and Phases 8 and 9 was computed for answering 

\ ■ . ■ ' • 

questions from^rally and silently read material. The percent change was greater 
for answering silent reading questions (average 35^) than for answering oral 

reading questions (28%). ' ' 

t ' 

DISCUSSION ^ 

^X^ln this study we found that the ability to answer comprehension questions 
was affected by type of question and mode of reading. 

As to type of question, the data Indicated that recall questions were more 
easily answered than either sequence or interpretation questions. This finding 
is consistent with other studies (Bickiey, Weaver, &, Ford , 1968; Pystrom, 1970; 
Feinman, 1972; Davis, 1;969.) . The emphasis placed on recall questions in most 
classrooms may have attributed tq these findint,?. . 

'According to Spache and Spache (1969), different types of comprehension 
are not acquired simultaneously by students; rather, each type must be taught ' 
separately. In our study all three types of comprehension Improved, although*^ 
some types of comprehension were more affected than others. The ability to 
answer interpretation questions generally Improved more than performance on 
recall or sequence questions. In some instances, the ability to answer recall 
quest Ions .was negatively affected by the intervention. 

In reference to mode of reading, the comprehension of orally read material 
wa% generally higher than comprehension of silently read material. Differences 
. between the abilities' to comprehend orally arid silently read material toward 
the end of the study might be expected, since interventions were only associated 
with -oral reading. The initial difference obtained between the^two modes, how- 
ever, cannot be easily dismissed. Our finding In this regard contradicted the 



evioisnce of rfther ^styd{e6 which compared oral and silent reacfl'ng comprehension 

with adult populations (Poulton S Browrt, 1967; Weaver, Holmes, s\Re^^nolds, 1970) • . 

Many aspects of comprehensioa meri t further investigation* For one, the 

abilUies of pupHs to answer other typesf of comprehension quest lonsl^hould be 

investigated. For instance, questions that require judgmental and lnfe\ent'ial 

sl<511s should be used. A second research area might pertain to mode of response,, 
* * ' \ * 

either oral or written. In this>tudy, the mode of reading lnfluence\i compt 
hension ability. Conceivably, mojde of responding could be an influential fact^r- 
The format of comprehension questions might also influence performance. \^ 
Investigations could be conducted to compare pupi L performance as a function. of • 
the following formats: multiple choice, true and. false, frfee responses, and . 

• / 

cloze procedures. . , . f 

Our plans for future reading comprehension research are two-fold.^ First, 
research will be conducted to investigate further the comprehension abilities 
cf pupils as a function oi oral and silent reading. We intend to .replicate the 
preserft study by measuring oral and' silent reading and the ability to compre- 
hend both modes of reading. In addition, we will' alternately schedule an inter- 
vent ion. Second, we wi 1 1 study the effects on performance of other types, of 
comprehensiorr-questibns. We will identify at least tw/> "higher levels" of com- 
prehension, write questions representative of the types, then msasur^^ perform- 
ance. IntarvSntlons will then be scheduled for the parlous types of questions^. 

At least 'ih-'-e implications for teachers of reading may be derived from 
this study.' One, each day the pupils read 1000 .^ords and answered 60 compre- 
hension questions. The time required to complete such an assignment was aboijt^^ 
30 minutes'. This was apparently a reasonable amount pf instruct ioryAl time, 
since all the pupils impr^ved>in reading and answering questions during the year. 



Two^ the simple instructional technique used in 'this study should be used 

. - ' ' • \ ' • \ " ' ' 

by teachers. The drill technique, ^tthough it required -l.ittle time, resulted 

in positive changes for all the ^pupils. There are perhaps fwo reasons to acpount, 

for this: •'a) dr1ll was scheduled only i'f performance was'poor, and b) when drill 

was used the procedures were consistent from one day to the next.^ . 

Three, the Idea of presenting unlforJn types of ocHnprehension questions to* 

assess performance in that- regard sfipuld1)e considered. Throughout thfs project 

the pupils responded to questio'hs that related to three types of comprehension; 

these questions were developed by the teacher. We knew, therefore, how the stw 

V ' , . , ^' • 

dents could perform over a period of time on each type of question^J Commonly, 

/ . - .. 

.when comprehens'ion abi l i ties are assessed, students are asked to respond to ^- 

• ' : ■ ' . * ■/..••■• 

several types, of questions i^ various ways. * 

the Implications could be^cmphaslzed and summariMd by recommending that 
teachers: a) pinpoint the reading behaviors they ^nt to tisafeh, e,g-. , oral fead- 
ini b) arrange ^ situaflon wftefe these .beha<?U)rs.'^ can .occur daily; c) measure 
the pupils' performance on each of J::^ese behaviors; d) schedule, Jf necessary, 
simple' interventions to increase the ^u'pils' <jompetenc1es; and e) cqntinue. to 
measure pupil performance in order to ascertain theynf^uence of teaching. ^' 
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Table ] ' 



Correct* Percentage for Answering 
Oral Reading Xomprehens ion Questions, 
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Phase 1 


Phases 8-9 ; 


Diff. . 


% Change 
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'Table 2 



Correct Percentage for Answering 
' Comprehension Questions After Oral and Silent Reading 



Mode 




Phase 1 


Phases 8-9 
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% Change 
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ABSTRACT 

The effect of one type of feedback on the ability of students to compute 
three kinds of arithmetic problems, .and the effects of three types of feedback 
on one Wx\A of arithmetic problem, were Investigated. Three problem types 
were identified for eat' \ student prior to the baseline condition. Initial 
Acquisition (lA) consisted of problems that the students could not compute; 
Advanced Acquisition (AA) problems were those the pupils computed between 40- 
60? accuracy; and Jnltial Proficiency (IP) problems were those computed by 
the students with a high degree of accuracy, but at a rate less than half of 
normal. The subjects were seven boys between the ages of nine and eleven. 

The first type of feedback. Correct and Incorrect Notaflon, when sched- 
uled for lA problems-, was not effective In increasing accuracy for any stu- 
dent. When this type of feedback was applied to AA problems, the perforjnance 
of only one student improved. The application of the same type of feedback 
to IP problems resulted in minimal increases in correct rate for two students. 

' Two other types of feedback w^re used with I A problems— Correct Answers 
to Erred Problems and Correct Explanation for Erred Problems. Neither type^ 
• of feedback greatly Influenced accurate computation. 



THE MINIMAL EFFECTS OF THREE DirPERENT TYPES OF FEEDBACK 

..3 



IN THREE DIFFERENT ARITHMETIC SITUATIONS'. 



^ Colleen Si Blankenship and Thomas C. Levitt 
University of Washington 

One of the main goal^s of a mathematics curriculum is-to teach students 
to compute accurately and rapldfy. In order to teach these skills, classroom 
teachers use^jnany techniques. They use model ;ng procedures by showing pupMs 
how to perform the problems, Th4y use Instructional aids such as cuis^nare 
rods, the abacus, and the numberftrte. Sometimes various types of reinforce- 
ment contingencies are scheduled. 

Perhaps the technique most widely used, however, to facilitate arithmetic 
computation is some form of feedback. Feedback, or knowledge of results, has 
been deiioed as, •*provt dLLi^ the. students wi th InformatJon -(knOw_ledge)^ahout the 
adequacy (results) of hi response** (Anderson S Faust, 1973» P* 271). 5 

We conducted an informal survey which suggested that Jieach'ers provide 
students knowledge of results in several^ways. The three most common types 
of feedback were giving comments such as **gc5od work*,*' noting t1ie correct score 
and checking incorrect problems. Teachers Indicated that they frequently com- 
bined feedback types. 

The p^r4dominant areas of research on feedback have been concerned with 
Its effect on performance in programmed materials (Anderson S Faust; Geis b 
Chapman, 1971), and on simple motor tasks (Annett, 1969)- A few studies have 
investigated the effect of feedback on academic tasks. 

Kirby and Shields (1972) used a combination of praise and feedback. Cor- 
rect answers were noted, but the student was neither shown where he had macTe 
an error in computation nor how to solve erred problems. The feedback plus 



reinforcement condition resulted in an increased rate of corrept responding 
as well as increased attending. However, the effect of feedback alone could 
not be separated from praise. 

Hillman (1970) compared the effectiveness of imrnediate knowledge'^of re- 
sults (KR), KR plus: token reinforcement, and delayed KR with no token rein- 
forcemen^t. According to Hillman, immediate KR amounted to the teacher ver- 
bfalizing the correct answer following the solution of each problem by the 
class. As for delayed. KR, the teacher read the previous day's correct answers 
to the students before they begfan the daily assignment. Hi 1 Iman concl oded 
that immediate KR and KR-^lus reinforcement procedures were superior to de- 
layed KR. No significant difference was found between KR and KR plus token" 
reinforcement, in his study the effect of feedback alone could not be deter- 
.miaed-tecause alLtreatment-groups-received instruction as well as feedback. 

The effect of feedback in the absence of instruction has-been investigated 

(Smith, 1973) • In her study two problem types were identified. One type, 

acquisition, pertained to problems the students ^uld not compute. Aoother 

^type, proficiency, referred to problen»s thje students computed accurately, but 

tQO slowly. In her investigation two kinds of feedback were employed: Check- 
' ' /- ' 

. ing Correct and Incorrect Problems and Providing the Correct Answer to Erred 

Problems. Neither type of feedback served to increase accuracy jDr rate in 

either the ^acquisitionor proficiency situation. 

Smith suggested that another investigation should focus on the effect .of 

feedback on a more advanced stage, 6f acquisition, one where the accuracy 

scores of students were about 50^>. In the research presented here three per- 

formance Ifevels were identified. As in the Smith study, acquisition and pro- 

ficienc^ problems were included. A third skill level v.as also included-- 



advanced acqui si t ion--which referrecj to problems computed between 40 to S0% 
accuracy. 

The purpose of this research was to determine the effects of one type of 
feedback on students* ability to compute three kinds of arithmetic pr^atj^s, 
and the effects of three types of feedback on one kind of arithmetic problem. 
ThjB effect of one type of feedback across all performance levels was initially 
investigated. Correct and Incorrect Notation was applied first to initial 
acqujsition (lA), then to advanced acquis't-Ion (AA) , and finally to initial 
proficiency (IP) pages* Two other types of feedback were then applied to the 
I A pages. 

METHOD 

Subjects and Setting 

Seven boys from nine to eleven years of age participated in this study- 
The setting for this research was the Curriculum Research Classroom of the 
Experimental Education Unit, Child OaverSpment and Mental Retardation Center, 
University of Washington. 

Preliminary Procedures 

Prior to the baseline condition, extensive placement testing in the four 
basic computational operations v/as scheduled. On the basis of this testing, 
which ran for thrfee days, th;ree problem types were identified for each student 

The criterion for selecting the lA problems was that the pupil should 
score from zero t<? ]0% on a set of problems for five consecutive days. For 
the AA problems the student should score from ^0 to 60% correct for five days. 
The IP problems were those v^hich were answered 90 to 100% correctly, but at a 
ra,e less than half of normal. In this study the normal correct rate was 50 



per minute; the normal error rate was zero errors. These rates were derived 
from an informal study of the rates in the four computation^ operations of 
regular public school children. 

Design 

A multiple baseline design was used. Our original plan was to schedule 
f^trst one type feedback on ah I A page. The same type of feedback was then 
to be applied in successive phases to AA and IP pages. Next, we planned' to 
schedole the secord type of feedback on an I A page (if the first type had not 
been successful), then on an AA page, and next on an IP page. Then, we in- 
tended to schedule, if necessary, the third type of feedback across the three 
types of MToblem^. Since the first type of feedback was so ineffective when 
it was applied to I A, AA, and sheets, v/e decided not to abide by our orig- 
inal plan of scheduling all three types across the^three situations. Instead, 
we decided to use all three feedback types with only the lA problems. Then, 
if one' of the feedback types proved successful, it would hp re-scheduled for 
other types of problem,^. One student's accuracy on lA pages increased sub- 
stantialW during a feedback condition. With iiim the same type of feedback 
was scheduled next for his AA page. Table 1 shows the order of experimental 
conditions throughout the research. 
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Insert Table 1 About Here 



Following the baseline condition, Correct and Incorrect Notation was 
scheduled on lA pages. This technique was then applied in successive condi- 
tions to AA and IP problems. Correct Answers to Erred Problems followed by 
Correct Explanation for Erred Problems was then 'scheduled for lA pages during 



the next two conditions. When a feedback condition was In effect It was 
arranged for only one type of problems at a time. 

Materials ^ . 

For each student, 25 problems were selected for each of the three problem 
types. A set of five forms was developed for each type. The student's daily 
assignment consisted of dittoed pages of three problem types, or accordfng to 
the procedure, one problem type dally and three problem types every other day. 
The order in which the problem types were presented varied, e.g*, on some days 
pupils began with an lA page, on other days with an IP f^heet. 

The composition of each student *s pages varied according to individual 
placement performance. As to the lA problems, three students were assigned 

division facts, one was given multiplication facts, one received two-dig i t-by- 

. r -^-^i - 

two-digit subtraction problems with borrowing one was assigned three- 

digit subtraction problems with no borrowing [ 9&9l» ^nd a.pother worked on 
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two-dicit-by-two-digit multiplication problems wTYh no carrying [^\'^y 
regard to the AA pages, five students were assigned multiplication facts and 
one student, subtraction facts. An appropriate AA situation could not be 
determined for one student, he either knew the problems or he did not. As 
to the IP pages, five students worked on subtraction facts, one on add facts, 
and one on division facts. 

* * 

Behaviors Measured 



Both percentage of correctly computed problems and correct and^error rate 
data were charted daily" for each student on all three pages. A problem was 
c(xinted as an error if a pupil wrote an incorrect answer or if he placed a 
check next to it, which indicated he did not know the answer. 
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Procedures 

Math pages were presented to the students as either their first or second 
assignment of the morning. The studei>ts were asked to answer each problem, 
but if they did not know an answer, they could place a check [/] next to It. 
No other instructions were given. Each student used a stopwatch to^time his 
own work, a student finished each'^page he raised his hand to have his 

time verified by the teacher. 

Basel ine . During the bsseline period neither Instruction nor feedback 
was provided for any of the pages. 

Correct and Incorrect^ Notation (CiN^*^*^). When CIn' was in effect each 
student was presented with all. three pages. During CiN and CIN the pages , 

^ 

v;hich did net receive feedback wer-^ presented evervother day. 

The problem type whi ch was scheduled jfor the intervention was corrected 
and returned itrmediately to the student. The teacher informed the student she 
had placed a "check" by incorrect problems and a "c" by correct problems. She 
then asked -the student to look- over his corrected page. 

No feedback was given on the other pages. The intervention was first 
arranged for the lA page (CIn'), then the AA page (CIN^). then the IP page (CIN^). 

Correct Answers to Erred Problems (CAe')- Each student was presented 
with an lA page daUy; AA and «P pages were scheduled every other day. The 
lA page was corrected and returned immediately to the student. The teacher 
informed the student that she had placed a "check" by incorrect probiemsjand 
a "c" by correct problems. The teacher wrote in the correct answer for incor- 
rectly answered problems and asked the student to look over his corrected page. 
Mo feedback was given cn the other pages. 
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Correct Explanation for Erred Problems (CEE) . 'Each student was presented 
with an lA page daily^^ AA and IP pages were scheduled every other day. The lA 
page was corrected and returned immediately to the student. The same informa- 
tion provided in the previous condition was given. 

In addition, the teacher, pointed out each incorre(;tiy answered problem and 
gave a verbal explanation regarding the correct process for solving the problem. 
For the three students who were, assigned multiplication or division facts; the 
relationship between families of problems vas explained, e.g., .5 x 8 ^0 is 
related to 8 x 5 ^0* For the students who weie assigned pi-oblems thq^ re- 
quired a special skill such as borrowing, that particular feature was explained, 

/ 

e.g., they were shown how to cancel out some numbe'rs^^ and shift numbers across 
columns. After the teacher explained the process to be used for each erred 
problem, she asked the student to look over his corrected page* 

Correct Ansv/ers to Erred Problems (CAE This type of feedback was sched- 
uled for one student, because his accuracy on JA problems Increased substan- 
tially when CAe' was scheduled. J.^e student was presented with an AA page^ daily 
and an lA and IP page every other day. Information provided to the student was 
the same as in CAE , but directed toward his AA page. 

.Change Criteria 

A baseline condition v;as scheduled for the first five days of the study. 
Each condition thereofter ran at least six days. After si^ days a decision was 
made whether to, continue the condition or to change. In order to make this 
decision on I A and AA page§, the mesp percentage correct score of the first 
three days was compared to the mean of the last three days. If the mean per- 
ccntage of the last three days was less than 301 higher than the mean for the 



first three days, the condition was cfiscoritinued. If the .mean percentage cor- 

= . , '1 

rect score of the last three days was more than 30% higher than the mean of the 
' - ' • ■ >• ■ . . 

first three days-, the condition ''continued "for three more days. At the end of 
that time a comparison of the mean'for the second and third three-day periods 
was made with the mean of the' first three-day period. The criterion for con- . 
tinuing or discontinuing the condition was based on the same 30% figure. At 
no time, during successive three-day mean comparisons, was a condition aljowed 
to continue if the percentage correct score was less than it had previously ^ 
been. Because it is not possible to calculate 30^ of zero, a 12^ score was ! 
considered to be the minimum acceptable score on lA pages with a mean of zero. 

y The change criterion on tP pages was based on correct rate improvement, 
since IP problems were those which were computed accurately, but at less than 
half the normal rate. As was true with lA and AA pages /"success ive"Three-day 
periods were compared and procedural decisions were based on those evaluations. 
If a student did not improve his correct rate by 30^ across successive three- 
day periods the condition was discontinued. If correct rate Improved more 
than 30^, the condition continued and v/as evaluated following another three- 
day period, * ^ 

A condition would be terminated when a student met criterion perforn^ance 
for three consecutive days. Criterion performance was defined as 100^ on lA 
and AA pages, and a correct rate of 50 per minute and zero errors on IP pages. 

Rel iabi 1 i ty 

Reliability was taken on teacher procedures, timing, and paper correc- 
tions- Rel iabi 1 itvscpt^es on each measure were obt^aincd by dividing the number 
of agreements by the total agreements pi uT disagreements and multiplying by 100. 
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Reliability on teacher procedures wai' taken on four occasions. An indo- 
pendent observer was given a copy of the ^feedback procedures, whereupon th^ 
observer checked the accuracy o,f the^ teacher* s comments to students under e^ch 
feedback condition* On each occasion, according to the written procedures, the 
feedback provided by the teacher vi^s correctly administered. ^ 

Timing reliability was obtained by requiring both the teacher and observer 
to note ihdependefrtly the elapsed tiji^ on the students* stopwatches. Timing • 
rel iabil it^ was taken on four^ occas ions, reliability was" 95% for the 30 stop- 
watch readings taken by the teacher and obserx^er. 

- An independent observer recorrected fTve^^ges of each problem type se- 
lected at randpm from each student's file^ The observer noted the number of 
correct and- i niporrect problems, calculated correct and. error rates, and per- 
ceMage correct scores, ^^n^easure of reliability was obtained 'by comparing the 
^ observer's corrections with the permanent record written on top of each page. 
ReUability on 'paper corrections was 100^. 

' ^. > . ■ 
-.•^ - ' ■ . . % - ) 

RESULTS 

In general, the three types of feedback were not effective in increasing 
accuracy o^ rate of performance for the students. There were exceptions, how- 
ever. In the few instances .where feedback was effective, individual data are 



presented 
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^ In order to discuss the effects of feedback, we chose to present magnitude 
of change as being *Might,*' '^minimal,'' and "substantial.** Slight changes ware - 
those v/he re the p^^rcentaae score difference between baseline and intervention 
WiLS leS3 than 5 perc^^ntoge pointsT Minimal change v/as if the gain ranged from ^ 
6 to 19 percentage points, and substr^^t ial i f the gain exceeded 20 percentage 
points. • ' ' 



The mean pecformance of the group, during baseline on tA was )\B% and k6.k% 

' ' , - * 

on KK. The mean correct rate on the TP "pages was 12.0 movements per minute; 
the mi^an error rate was ,6 movements per minute, * - ' 



When Correct and Incorrect Notation was appiied t^ I A pages, It resulted 
in a slight average Increa'^e ^in accuracy: ,6 percentage points, Th^ accuracy 
of two students IncreaseS ^1 Ightly and the accuracy of tv^o" students decreased/ 
slightly during thfs condition/ Three students maintained their previous- base- 
line scores of zero. Table 2 shows the pupils* scores ori the iA problems^ dur^- 
y . 

ing this phase' and throughout the" experiment. ' - ^ 



Insert Table 2 About Here 



*— 

WFfen "Correct and tncprrect Notation feedback was associated with the AA 
pages, the mean percentage correct score, for that type problem Increased 5*^ 
percentage points over the prior two conditions. The performance of two pupil 
was slightly affected, while a minimal Increase was' noted for a third student. 
Two stifdents* accuracy decreased during this condition. Table 3 shows the 
pupils* scores on AA problems throughout the experiment. 

h 

- ' \ 

Insert Table 3 About Here 



Individual data are presented in Figure 1 for O.H. since his performance 
was influenced more than the others by this type of feedback and continued to 
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Improve after this concfition was no longer in effect. 



Insert FiguVe 1 About Herfe 



din3 " 

' ... , . 

When Correct and Incorrect Notation feedback was, applied to IP pages, the 
mean correct rate increased 2.4 problems per minute; the error rate increased 
an average of .1 problems per minute. Table k shows the pupils' scores on the 
--IP^ problems. ' T ^ 



•Insert Table h About Here 



Five of the students* correct rates increased less than 2 problems, per 
minute^ while the correct r*ates of two pupils, D. P. and B.W. , increased -by-6 
problems per minute. sTnce B.W". *s correct^ rate wa% affected more than the- 
others during this condition, his data are shown in.Figurfe 2. 



Insert Figuce 2 About Her« 
„ — - 

rrr.-l • • • . y 



When Correct (>nswers to Erred Problems ffedback was applj>ed to *IA p^ges 
it resulted io a heart ihcrease of 1^.3 percentage' points over^^the previous two 
cooditions. During this condition the accuracy of two students increased 
slightly, while a third student's scores showed minimal improverrent . Jhe % 
scores 'of two students nt^intained at the) previous ttaseVine level of zero. , 

.The f^erformance of M.'S. was substantially increased by this type of feed- 
back; his accuracy rp3e from zero to 891 correct.. Although M.Sv attair.:»d scores 
of JOO^ during this condition, he failed to meet criterion pei'formante of three 

o * " - ' • ,^ ' '''' . r ^ 

j^p^QsuccesSiive ]0^% secures. . '\ ^ ' ^ ^' 
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Proyiding Correct Explanation for Erred Problems feedback on lA pages re- 
suited in increases ^ each student's accuracy. Three students' percentage 
scores Increased slightly over the prior feedback condition, while one student's 
scores showed minimal improvemsnt . 

('oc student, M.S., met criterion performance when this type of feedback 
was schec ul.^.d.^ However, Correct Explanation for Erred Problems feedback was 
never in" e.f feet for him since he scored \0C% during the first- three days in 
t^ls xoodiVion. M.S. made his greatest gain during CAE and it was decided to 
applv that type of feedback -to' his AA page. 

Two students made substantial Improvement while this condition was in 
effect. During this, period, D.H.'s accuracy increased by 68 percentage points 
over the previous feedback condjtjon. He did not attain criterion during this 
condition, however. Another student, B.W., who had zero correct during prior 
conditions, increased his accuracy to 72% during this condition, but he did 
not attain the desired level of performance. Data for B.W. are shown in Figure 



Insert Figure 3 About Here 

CAE^ 

When Correct Answers to Erred Problems feedback was applied to M.S,*s AA 
page, his accuracy increased by .2 percentage points over the prior conditions 
of baseline The application of this type of feedback resulted In decreases 
in both correct and e»-ror rate compared to the prior baseline conditions. 



} DISCUSSION 

Research in programmed instruction suggests that It Is better to note 
errors than to ignore them (Anderson S- Faust, 1!J73)* In our study Correct and 
Incorrect Notation resulted In an average percentage gain only ,6 points in 
lA situations, 5.^ points in AA situationsT, and increased correct rate on IP 
pages by an average of 2,^ movements per minute. Errors were ignored during 
the baseline conditions and were noted during the CIN ' '-^ conditions. Unlike 
the suggestion of Anderson and Faust, the effects of CIN on three levels of per- 
formance were very unimpressive. ' * \ 

Anderson and Faust, also stated that when a: student must select an answer 
from a large set of alternatives, knowing that an ansv^er is wrong wjll not be 
helpful in determining the correct answer. This explanation is especially re- 
levant to the lA situations when only the CIn' feedback was scheduled. Although 
the students knew when they had err^d, this information was not sufficient for 
them to correctly compute their problems. In these instances our firdings 
agreed with Anderson and Faust* 

2 

The accuracy of one student, D.H,, increased* on AA problems when CIN was 

in effect. His improvement may have been related to the type of problems on 

his AA page; 7 of the 25 multiplication problems contained a zero. Prior to 

the CIN phase, D,H. consistently erred on this type of problem by writing a 

2 

numeral other than zero as the answer. During CIN , he generally computed 
problems involving a zero correctly. If D.H. had computed all problems con- 
taining a zero consistently he would have gained 28 percentage points. As it 
was, he improved 25 percentage points. Thus, CIN probably helped D.H. learn 
J rule that could be generalized to a set of problems. 
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Anderson and Faust concluded that it is better to provide the correct 
answer than to check correct and incorrectly computed problems. When this 
technique was applied in I A situations the class mean rose by 15.3 percentage 
points. The scores of two students remained at zero. Our data in this regard 
are not strongly supportive of the Anderson and Faust claim. M.S.'s accuracy 
increased substantially during the CAE^ condition. His increased accuracy 
during this condition may be related to the^ type of error he made. His lA 

problems c.nd answers were of the type, -921 Hi« error patfern was obvious, 

' . OTV 
he placed an unnecessary zero in the hundreds column. Onc6 the teacher pro- 
vided the correct answer, his accuracy immediately increased. This same type 
of feedbacit was then applied to M.S.'s AA page which consisted of multiplica- 
tion facts. Quite different results were obtained; M.S.'s accuracy increased 
by only .2 percentage points in contrast to a gain of 89 percentage points 
when CAE^ was applied to hi*; lA page. 

Two other students, D.H. and B.W., also computed problems which were more 
advan-ced than those assigned to the other students. However, when they were 
provided CAE feedback for problems of the type 33 . H 

(correct answer 19) ^' (correct answer 209) 

Tfo 

their performanoes did not improve. Contrary to the claims of Anderson and 
Faust. CAE did not substantially improve performance. Those students who were 
working fact problems, and those who were making process errors (of th(? type ■ 
made by D.H. and B.W.), were not aided by the a^pl ication of CAE. Providing 
a student with the answers to 25 fact problems would require him to memorize 
many answers; while providing answers when a student is making process errors 
does not give him sufficient information to compute problems correctly. 
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CLE feeciLjck resulted in the highest percentage gains by all students. 
The accuracies of the three students who were assigned advanced computations 
substantially increased when CEE was provided. The accuracies of four students 
who were assigned fact problems increased less than 8 percentage points, which 
indicated the acquisition of only two unknov^n problems. ^ 

In this study, the three types of feedback investigated had minimal effects 
on students* accuracy and rate of computat 101:1. Certainly a great deal more re- 
search should be arranged to explore the effects of other types of feedback on 
other types of performance. 

Feedback studies should be conducted with pupils of different types. The 
pupils in this study had experienced failure. In the past when their papers 
were returned to them perhaps all the feedback was negative. Perhaps these 
pupils learned to ignore feedback since it was generally aversive and as a 
consequence this form of instruction was ineffective* It might be discovered 
that a tolerance for feedback must first be developed before various feedback 
procedures ^re effective. At any rate, teachers, particularly of academically 
retarded children, should consider carefully the style of feedback they arrange 
for their children* Certainly the results from this study could not be used 
to support the currect widespread use of feedback procedures in schools. 
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FIGURE CAPTIONS 



Fi-qure ] ; Percentage correct for D^H.»s problems under all conditions. 

Figure 2 : Correct and error rate data for B.W. 's IP pages during all conditions, 

r 

Dots indicate the correct rates^, triangles the error ratei.' An appropriate 
AA situation could not be determined for this student, therefore, Condition 
3 was never In effect. 

Figure 3 : Percentage correct for B.W.'s: lA problems. An appropriate AA situa- 
tion could not be determined for this student, therefore, Condition 3 was 
rtever in effect. 
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Figure 1 



CC 
C£. 
O 
O 

t- 

UJ 

o 

CC 
Ul 



loo- 
se 
80 
70 
60 
50 

30 
20 
10 



Baseline 



sm3 



CAE 



CEE 




10 20 30 



1,0 50 60 70 80 90 100 no 



SUCCESSIVE .CALENDAR DAYS 



Figure 2 



LLf 

H- 

ec 
us 
a. 

c/> 

H- 
Z 
UJ 
X 
Ui 

> 
o 



too 

50 

10 
5 

1 

.5 



.05 



.01 



Basel in^ 


cin' 




t 


A 




AM AM. 




0 10 


20 



CIN- 



CAE' 



CEE 



V 



10 20 '30 'to ; 50 60 70 80 90 100 

f 

SUCCESSIVE CALENDAR DAYS 



Figure 3 
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AS3ESSMEMT, INSTRUCTION, 'AND INTEGRATIOli 
OF HANDICAPPED CHILDREN 



Introduction 



There ha$ been an Increasing local and national emphbsts In the 
past fl^e years on the effective Instruction of handicapped children and 
their expedient return to school and vocational settings In the community. 

The efficient /emedlatlon and r^i:urn of these handicapped youngsters 
to more noVinal settings requires systematic referral, assessment, reme- 
diation, return, and evaluation procedures (subsequently referred to as 
the referral-remedlatlon-relntegratlon process). !n the past two years 
Team It has focused on those components of the total referral-remedlatlon- 
ref ntegratlon process necessary to successfully return handicapped 
children to programs as close to regular education programs as possible* 

Some of^Hthe essential elements In such a process are: 

I* A measurement system which will give educators the necessary Infor- 
mation to make good decisions about the effects of Instructional, 
currlcular, and measurement >:^rlables on tfielr pupils* progresi 
toward proficient performance. > 

II, An Information storage and retrieval system which enables admlnl- 
strators to retrieve precise Information about any pupil and evalu- 
ate how efficiently he Is progressing toward performance levels 
necessary for successful reintegration* 

intake, return, and follow-up procedures which ailow for accu- 
ratc assessment and placement of children upon referral, b) expe- 
dient return te a community setting (e.g., special education -^lass, 
regular class, vocational program, sheltered workshop) after reme- 
diation, and c) follow-up processes which can monitor the child's 
performance once he Is returned to the community setting. 

i% ^^rodedures for establishing long range criteria for each student 
and measuring proficient performance at each Intermediate step 
toward the long range goal. 

V. Pre jse and efficient Instructional and n?anagement procedures which 
allow for the rapid remediation of the chl1<f s academic and social, 
probl^s* 

Mark done In each area will be reviewed and summarized In narrative 
In the following report. Fgll.pxoject reports- are available upon request. 

/ 

) 



Area i : Measurement 



Rationale 

Any program designed for promp't remediation needs a measurement 
system which efficiently provides Jnformatlon sufficient to make educa** 
tlonal decisions. Educators are beginning to realize that traditional 
educational measurements, such as standardized or norm-referenced tests, 
do not give teachers or researchers the necessary Information tc make 
good decisions about the effects of currlcular. Instructional, or 
environmental changes on pupil performance ,( Eaton e Lovitt, K/ij. A 
system of dally, direct measurement which does provide adequatt and 
prcr.ipt feedback about the effects of any change In pupil performance has 
been developed (Llnd:5ley, 196^). However, as with any new system, 
refinements are needed. Team 11 has Investigated various aspects of 
this system as It relates to the needs of both the classroom teacher and' 
the researcher. 

Progress 1973-197^ . ' ^ - 

Team It Investigated three major areas during 1973-197^: 

1* Program changes based on data, 

2 The adequacy of non-conttnuous data, and 

3. The effects of self-charting on pupil performance. 

The results of the studies In each area will be summarized below. 

Decision-making rules . The procedures for collecting direct and daily 
measurement are currently being used in numerous classrooms and centers through 
out the United States and Canada.' Centers such as the Experimental Education 
Unit are continually In the process of revising and refining the data collectto 
procedures. 

As more data are collected by teachers and administrators, methods for 
precise and efficient data analysts become Increasingly Important. Teaching 
data collection procedures without concurrently teaching techniques of 
data analysis Is like handing someone the key to a car without teachlng^hlm 
to drive. Therefore, Team II summarized data decision procedures currently 
being used at the Experimental Education Unit In a format which could be 
used for dissemination. This summary Includes sections which outline the 
rationale, procedures, and exceptions or cautions for the following areas: 

1 . Dal ly rate data 

a. Medians ^ 

b. Lines of progress 

c. Start rate, end rate 

d. Minimum acceptable progress 

e. Minimum acceptable performance levels 

f. Mlnlmu . days at criteria performance 



-3- 



2. Dally percent data 
a. Medians 

,b. When to change Instructional plan 
c. Record floor 

The adequacy of non-continuous uata . While perlocic assessment of pupil 
performance undoubtedly remains the most common method of classroom evaluation, 
that portion of the educational coonunlty v/hlch works within a PrecisJon 
Teaching- framework has advanced persuasive argument's for the employment of 
continuous (dally) measurement. Such arguments have appeared m both journal 
articles (Gaasholt, 1970; Eaton S Lovltt, 1972) and texts (Harlng & Phillips, 
1972; Kunzelmann, 1970). In general, these works emphasize the utility of 
continuous measurement In ongoing decision making and planning. Continuous 
measurement allow for a description of pupil progress at any given point In 
time and provides a basis for the prediction of future levels of pupil perfor- 
mance (White, 1972). 

\/hlle the a vantages of dally measurement In terms of ef 'active pupil 
evaluation have been well articulated, the question of teacher time-cost has 
been largely Ignored. It Is obvious that 'continuous mea^^urement , under most 
conditions, requires^ a greater expenditure of teacher ..^Cljme and energy than 
periodic measurement*^ There secq: to be at least three ways In which time con- 
sumed In continuous measurement might be reduced. 

First, the amount of measurement time each day may be decreased; that Is, 
rather than measuring pupil performance on a given subject for, say, thirty 
minutes each day, one minute samples (or probes) might be taken and subsequent 
evaluations be based upon data obtained during those one, minute samples. 
Unfortunately, the usefulness of such short samples for either descriptive or 
predictive purposes has not been f I rmly established. In addition, the results 
of a recent study by Billings ley and Swenson (1973) have suggested that short 
samples may not provide a satisfactory assessment of pupil performance In pro- 
grammed reading *:exts. 

Second, teachers may train their pupils to become skilled in data collection 
and recording (see self char tlrig^ section In this summary, p.' 5). Trtls would 
seem to be a highly satisfactory technique, assuming that pupils can collect 
reliable data: Children can also be trained to colled dato for each other. The 
information collected could be entered Into the computerized systems which are 
currently being developed In the field of "educdftlon (see p. 7). 

A third method would Involve making measurement *'le^s cont i,nuous"; that is, 
data would be collectied often, but not on a daily basis. If less than 
dally measurement Is to be considered a viable alternative, then the results 
of this type of measurement should be shov;n to closely approximate those 
obtained from continuous dally measurement In terms of descriptive and 
predictive properties. It Is this question which was addressed by the 
following study. . ' ^ ' 



An Examination of the Adequacy 
of Non-Continuous Data 

Felix Bllllngsley 



This study examined the extent to which median slope Unes-of- 
progress (trend lines) and median rates obtained from frequent, \but . 
non-continuous, classroom correct rate data would approximate those 
obtained fron) data collected on every available class day* Data for ' 
analysis were taken from phases containing at least eleven data points. 
Of the twenty phases employed, ten contained absences and ten contained 
no absences. All phases Involved performance on academic materials. 
Lines of progress and median rates for the original phases, and for 
the same phases with every third snd every other datum point omitted, 
were determined* Agreement coeff Iclents were computed between the 
values obtained for the original phases and for the phases with data - 
points omitted* A high degree of agreement was observed between lines 
of progress and between median rates; In the case of lines of progress, 
however, slightly lower measures of agreement resulted from the omt?sloi> 
of every other datum point. It seems, then, that data collected 
often, but not dally, can give an educator accurate Information regard- 
ing median performance, but Is not as accurate In calculation of the 
I ine of progress. 



The Influence of viewing charts and self-charting on pupiPs performance . 
A second method for reducing the amount of teacher time required to take 
direct and dally data Is to have the children themselves take some of the 
responsibility for correcting and charting their work*. Swcnson (1973) ' 
demonstrated that self-correcting of academic materials results in a con- 
siderable time savings for teachers* Self-charting might also resultjn a 
saving of time. 

In addition, self-charting or self-correction might have beneficial 
effects for the pupil as well* A long range goal of education Is to enable 
children to live I ndepe.4lently and manage their own affairs* One way to 
prepare children for Independent living U, to teach them basic skills. 
People who can add and subtract accurately have the Initial skills for 
balancing a checkbook. People who caa read proficiently are usually able 
to Inform themselves about events and knowledge which affect their daily 
lives. A second and much neglected way to prepare children to live Inde- 
pendently is to give them experience managing some aspects of their own 
environment* Lovltt and Curtiss (1969) suggested that the properties of 
self -management might Include assessing one's own conpetencles, setting 
one's own behavioral objectives, and arranging contingencies for oneself to 
achieve selected objectives* Lovltt (1973) further delineated t;'>e proper- 
ties of self-manegenent as selecting a skill to be achieved; scheduling a 
time for learning; presenting stimuli to which an Individual can respbnd; 
confirming the responses made to the stimuli; reinforcing approprl^ate, 
responses; recording relevant data about the responses; and evaluating the 
Individual's performance. Lovltt presented a number of projects whereby 
different se I f -management activities were assigned to pupils. For example, 
self-scheduling of subjectii, self-correcting of answers,' self-counting and - 
recording of data, self-charting, and self-selection of contingencies were 
Q ' among the Intervention activities delegated to children. 

ERIC 



The systemaMc replication of self-management Interventions is a needed 
element iri self-management Investigations. Team 1! conducted two studies 
to Investigate the influence of self-charting on academic performance. 



The Influence of Viewing Charts 
and Self-Charting on Pupil's 
Oral Reading Performance 

Dale Gentry, Georgia Adams, and Lestra Hazel 

The purpose of the first study was to ascertain, for eight 
different children, the influence on reading rates of two different^ 
sf If-management interventions, namely viewing their own oral reading 
cliarts, and' charting their own reading rates* An equally important 
goal was to teach the children to chart and to become more personally 
involved in the US9; of data. Median performances, correct trends, or 
error trends considered separately did not indicate that self-charting 
or viewing their charts had a beneficial effect on pupil performance. 
Specifically, only for one pupil were the correct medians higher 
during experimental phases than during baseline conditions. Ilo pupils 
had consistently lov/er error medians during experimental co-^dltions 
compared to baseline. And, while four of the pupHs had better error 
trends ( I .e. errors were decel erat i ng .faster) for self-charting and 
self-viewing/ phases, no pupils had consistently better trends (i.e., 
v;here correct scores were accelerating faster) during self-charting 
and self-viewing phases. 

Only when the relationship between correct and error trends 
(Improvement ratio; was considered did one of the experimental con- 
ditions^ self-charting, appear superior to other conditions. The 
Improvement ratio for six of the eight subjects uas superior to other 
conditions during the self-charting phase. For a seventh subject the 
improvement ratio was better during the self-viewing phase. 

A' favorable Improvement ratio (x) Indicates a*^ increase in 
accuracy within a phase. The subjects in this study showed the 
greatest increase in accuracy within the ^elf-chart ing phase^ For one 
subject this was primarily becasue correct performance Increased while 
errors remained stable. For another subject the errors decreased 
while the correct rate remained stable. Errors decreased and the 
correct performance Increased for four other subjects. 

It Is reasonable to ask why only the improvement ratio, ano 90 t 
medians or trends alone, 'Indicated the superiority of self-charting 
over self-viewing. It seems probable that children who see their 
charts or y;ho chart their own data might focus on different aspects of 
the? data. Perhaps some-children are eager to increase their speed, 
other want to decrease their errors, wfiile yet others desire improve- 
ment In botb correct and error responsjs. 

(■ • ■ . ■ 
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The second study v;as prompted from the results of the first 
study* Since charting correct and error rates did not seem consis- 
tently to affect correct an*! ^rror performance, the authors felt that 
perhaps charting only correct or only error rates would have a con- 
sistent effect on the rates cha:-ted. Therefore, the purpose of th^ 
second study was to assess the effects of pupil self-charti ng only 
correct rates or only errof* rates. 

Median performance In the second study was the best Indicator of 
the effect of self-charting on pupil performance. For all pupMs, 
self-charting of errors resulted In a definite decrease in the median 
error He. It Is apparent, but not as definite, that self-charting^ 
of correct rates resulted in higher median correct performance. It Is 
possible that children were already performing near their practical 
upper limits, since reinforcement contingencies were alreJidy In effect 
for correct performance. 

Currlcular changes, that Is, children's advances to new Stories, 
occurred according to preset criteria and were Independent of self- 
charting phase changes. This confounded the Interpretation of per- 
formance trends and Improvement ratios. A subsequent investigation of 
this confounding effect will be conducted. 

The results of the second study show that^not dniy Is self- 
charting an effective tactic in changing pupil performance, but also 
show that charting specific performances (correct or error) yields a 
desirable effect on the performance charted. It is likely that other 
self -management studies will need to focus on specific self -management 
components. 



Considering that pupils were already under effective reinforce- 
ment conditions, and that the stories read daily were somewhat vari- 
able In difficulty, the results seem impressive. Self-viewing and 
self-charting area advantageous over no pupil Involvement with per- 
formance charts. However, self-charting was clearly superior to all 
other conditions, and self-charting of correct or error performance 
yielded a clear improvement In the particular performance charted. If 
such a small step as self-charting has such desirable effects, then 
perhaps other self*management activities, such as selections of con- 
sequences, could have even more notable effects. 
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Area II: Administrative Management Decision System 



Rationale 



Decision making Is one of the most Important processes that educators 
undertake. Teachers decide what specific objectives pupils sho»jld work 
towards, whether pupH progress toward those objectives Is adequate, and 
when pupils should advance to new objectives. Administrators determine 
pupil placement, evaluate overall pupil progress, judge the effectiveness 
of programs and procedures, evaluate teacher competence, select inter- 
ventions to Improve teacher competence, decide which supplies and services 
to purchase with available funds, and even evaluate their own performance. 

The range of decisions an administrator makes is large. But the 
syst^ematlc information he can use to make decisions Is usually limited to 
items such as the cost of resources and the number of pupils served. 
Traditionally, he has not had available the most Important source of In- 
formation and criteria for the efficacy of his decisions — the performance 
of pupils themselves. The past decade has seen the evolution of a measure- 
ment technology that allows educators to assess pupil performance data 
precisely each day. Of foremost importance is the use of those dally 
performance data to make direct classroom Interventions that help pupils 
progress In their own skills. In addition, the same data can be used to 
make administrative decisions about processes both in and out of the class- 
room. 

jf daily pupil performance data are used to make administrative 
decisions, some general requi rements should be met. First, the collection 
of such data should result in no appreciable Increase In demands on teacher 
time and energy. Second, the data should provide Information for making 
decisions, and should result in feedback about the effects of decisions. 
Third, different decisions require different data, so any data summary and 
reporting system must be f l^sxlble. 

The specific administrative requirements for a data summary system are 
that data must be: ^ 

1. current at the time decisions are made, 

2. succinctly presented, 
3- accurate, 

complete, 

5. exclusive, i.e., not Including extraneous information, and, 

6. easily Interpreted. 

Team 11 has begun develop a computer-based program that will readily 
meet the above requirements and provide essential and timely data upon 
which an administrator can make decisions ranging from the adequacy of a 
single puplTs progress to the selection of curriculum materials for a 
school. 
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Progress 1973-157^ 

Input formats . The number of Input formats has been Increased to 
allow teachers several alternatives for submitting puplTs^ daily data. 
This became necessary because the single Input form used previously re- 
quired much extra teacher time to use under some conditions. Currently 
five Input forms are available to teachers: 

1. jnultl-day pupil assessment event sheet, 

2. dally pupil event sheet, 

3. dally pupil schedule data sheet, 

h. v^eekly one pupil, one project data sheet, 

5. weekly multi-project, multl-pupll data sheet. 

The above forms enable teachers to submit multiple assessment data for 
analysis, to submit data on a dally or weekly basis, and to submit data on 
a single project with one pupil, on numerous projects with one pupil, or on 
numerous projects with numerous pupils. Because of the variety of Input 
formats teachers can collect and submit data with less expenditure of time 
than was previously possible. 

Output Information . A variety of output information is available to 
teachers and administrators In tabular and charted formats. V/ithin-con- 
ditlon summaries can be reported while a phase is in progress, or after a 
phase Is completed. Information may be requested for all data of a class, 
a teacher, a pupil, or a specific type of behavior. Between phase com- 
parisons may be made Including Immediate changes, changes In the line of 
progress, and overall change. Group summaries of data may be obtained by 
class, teacher, pupil, or behavior. 

Output formats . A variety of output formats can be requested as welK 
Results may be obtained either as tabular data or displayed on a chart 
which includes numerical descriptors. Graphic output of charted data will 
not only be useful as year-end summaries of sufficient quality to share 
with school dlstric^Tlind for publication, but will also provide an accu- 
rate model against which rhe^accuracy of our classroom charts can b^ com- 
pared and checked. 

Change codes and behavior codes * Procedures have been developed to 
enter and store a wider range of information about behaviors. A change 
code enables the teacher to Indicate which contingency or Instructional 
variable was altered. A method for precisely coding behavior has been 
developed. This code not only enables the computer to sori data for 
carefully defined behaviors, but ^so enables the teacher to Input to the 
computer some Information about th^lnstructional materials or context ^n 
which the pupil Is working. 

Interface with Intake-Return-Fol low-up . The computer programs have 
been adapted to the Intake-Return-Fol la^-jjp component of the project. 
Assessment data, once collected, are entered into the computer and results 
and charted data are returned within one day for analysis, decision mskino, 
and inclusion In a pupil's permanent record. In addition to the previously 
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collected Intake'-Return-Fol low-up data^ "p''og''ess reports" concerning 
grov/th in the same behaviors tested during Intake are also collected every 
quarter. Upon request the computer can compare the results of each new set 
of data collected on a child with the data previously collected, and indi- 
cate overall progress on either the printed or graphic output format. 

Data Jnput . Data have been submitted from five classrooms for three 
quarters on a^} pupils in^the classes. Currently the data which is of most 
benefit to teachers and admlnt-^t-rettM'^'-rsn^r^tKfh-pftas i nforrration , such as 
starting frequencies, trends, ending frequencies, medians, etc. The fact 
that data have been continuously submitted over an academic year (6000 data 
days or 100 data days per 60 children) demonstrates the feasibility of such 
a system. In addition, withln-phase descriptive data have been expanded so 
that teachers use the computer to calculate summary dato. In the past 
these data have been calculated by hand at the end of each quarter. 

Output request fo rms. The need for teacher output request forms has 

been eliminated. Regular outputs will be scheduled to meet the needs that 

are most common, and special requests will be handled through a data clerk 
until the nature of requests becomes fairly stable. 

Curriculum committees . Curriculum committees in the areas of reading, 
computationaF^rl thmetfc, and language arts continue to work on specifying 
and sequencing instructional objectives so„that data may be collected on 
standard tasks. Literature reviews, task analyses, and lattice development 
are at various levels of compl^etion for each of these areas. 

OemoQ rsph i c I nf orma t i on . Demographic Information is now secured and 
stored in the computer for each pupil enrolled in the EEU program. As new 
pupils are enrolled the information is secured and entered. This Infor- 
mation Is currently useful for describing characteristics of the population 
being served, reducing filing work and enabling at least tWo types of 
analyses not previously possible. First, tables may be constructed to » 
Indicate the number of children falling Into vario.us categories --cate- 
gories specified by any combination of the variables represented In the 
demographic data file. For example, for certain final reports we must 
indicate the number of children In each program by age and handicapping 
condition. Previously, this took several hours of personnel time, but now 
the computer does it In minutes at a low cost. Additional tables, useful 
to administrators, could be constructed to indicate such things as the 
amount of time on a waiting list by age and handicapping condition, the 
distribution of children in the EEU by geographic area (homesK length of 
time in the EEU by age at entrance, or source of referral by i.^ndi capping 
condition. It might also be noted that **handi capping condition'* may be 
specified in terms of* federal guidelines, state guidelines, AAfiD guide- 
lines, or any combination of those* The same file keeps name and addrei>s 
information for parents and guardians, and the sane system Is expandable to 
store information on other persons associated with or Interested in the 
work of the EEU so that computerized mal 1 ing lists could be constructed. 
In addition the demographic file is capable of searching the performance 
data set(s) and forming groups of data on the basis of child characteris- 
tics. When this demographic data Is Interfaced with pupil performance, 
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research could then be performed to compare, for example, the performances 
of children with varying types of handicapping conditions, varying lengths 
of stay In the EEU, or varying, ages. 

Exception report! ng * Exception reporting Is the only portion of the 
1973-197^ scope of work In whlch.no progress was made. Team It will be 
unable to complete ^ progr*am for exception reporting until the computer 
Input Is regularized and methods are developed for the establishment of 



aims* 
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Area Ml: Intake-Return-Follow-up 



Rationale 

There Is an increasing emphasis In education on the determination of - 
specific academic and social needs of each pupil. The present goal of many 
school districts is the placement of a handicapped child in a remedial 
situation for all or part of the school day. In most cases, the objective 
of such a pjacement is the eventual return of the chlH to a regular class- 
room setting to continue his academic and social progress. 
<• 

The process of referral, remediation, and reintegration requires con- 
sideration of several factors: 

1. IVhat are the student's academic and social performance 
deficits which need remediating? How are they' measured? 

2. How do these deficits compare to the performance level . 
of the referred pupil's peers? 

\3- 'How are objectives established which are a basl$ for 
reintegration back into the regular classroom? 

How long should the objectives be maintained before 
reintegration occurs? 

5. How long should the reintegration placement be monitored 
to Insure performance maintenance and continued progress? 

6» What are the most efficient p M:edures for use by personnel 
in publ i c i6chool districts?- 

The Intake-Return-Follow-up (IRF) procedures Investigated by Team It 
will supply^t^chers and administrators with Information which will help 
answer these^ questions. Team 11*5 objective Is to develop an efficient 
referral-remedlatlon-relntegration process which evaluates pupil progress 
and success at several points; "and can be used by public school teachers. 
This report includes a brief summary of 1972-1973 activities In the deve- ' 
lopment of Intake-Return-Follow-up procedures and a detailed summary of 
progress made in 1973-197^ toward the project goals. 

Progress 1973-197^ 

^ ^ ^ 

Review of first year; 1972-1973 * During the first year for Intake- 
Re turn^FoTTow-LipT~t^ : 

K a description of academic and social movement cycles for 
6 to 12 year old pupils; 

2r an Acaddf^lc Assessment Battery In the areas of reading, 
math, and writing skills; 
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a description of the Social Behavior Observation Scale 
for inappropriate classroom behaviors; and 



a description. of procedures for an efficient referral- 
remedlation^-relntegration process based upon the academic 
assessment battery and the social behavior observation* 



In 



addition, the following procedures were completed for fifteen 



pupl Is: 



1. referral from school districts; 

2. teacher conferences; 

3* collection of intake data; ^ " 

k. objectives conferences; and 
5. EEU placement. 

Revision and development of intake procedures > During the second year 
of the project, the existing Intake-Return'-Konow-up procedures were re- 
fined and others developed based on the data collected in 1972-1973. The 
proce4ures now include the following steps. 

tiame of , referred pupil Is obtained by admissions coordinator, 
based upon openings per class. 

.2. The Special Education director of the school district is con- 
tacted and a Gonferenc'3J attended by Special Education director, 
school principal, teacher, counselor, ^and EEU coordinator is 
held. At. this' conference procedures are explained; schedules 
established, and peers selected for data , col Ifectlon. 

,,3. Data are collected for the child's performance on the Academic 
and Social Assessment Battery for five days in his current 
placement. Data are also collected on the performance of two 
• peers selected by the referred chl Id' s teacher. The data from 
these peers are used to help establish the return placement 
objectives. Specific information Is obtained concerning the 
school setting of the referred pupil. This Includes a descrip- 
tion of current academic programs, successful and unsuccessful 
teaching strategies, and a description of the classroom design. 
With this type of information, in addition to the collected data, 
the prospective EEU teacher Is better able to construct the 
necessary Individualized prograOJ. 



An objectives conference attended by Special Education director, 
school teacher, principal, counselor, EEU coordinator, and EEU 
teacher is arranged. The meeting includes an explanation of the 
refults of the data collected and establishment of return place- 
ment objectives, both academic and social, based upon collected 
chHd and peer data. 




5. Progress reports are sent to the appropriate school for each 
pupil p.1acecl at the EEU through IRF procedures. Data for pro- 
gress reports are collected by administering the academic battery 
and collecting one^hajf hour social observation data for one 
complete week for each pupil once a quarter,. This procedure 
allow the comparison of lines of progress and median scores 
showing the quarterly improvement of academic and social skills. 
A. summary of the pup i T s. academic progress in relation to h.ls 
academic level at the time of EEU placement and his return 
placement objective is also added. This method of reporting 
academic and social progress has been informative, precise, and 
also allows for continual assessment of the return placement 
objectives for each pupIK 

Development of new procedures for the return process . The return 
procedures will include three conferences and the collection of return data 
to insure appropriate return placement. The three conferences allow for 
complete comparative analysis of all data describing the referred pupil's 
progress during his placement at the EEU. A transition program is also 
' established for the pupil so that the return placement will be less of a 
change. In order to develop the transition program the EEU teacher and the 
return placement teacher compare thei r educational settings and then deve- 
lop similar progreamr.. The results of the new return procedures will be 
documented when foPow-up procedures are completely established during the 
Fall Quarter, 1973. 

Revision of Academic Assessment Battery probes and social behavior 
observation procedures . , Each probe of the Academic Assessment Battery was 
revised so that all responses have been precisely defined and all probes 
can now be used for a complete analysis. of type and incidence of pupil 
errors. 

The revised social observation procedures for inappropriate behaviors 
were developed with consideration of two objectives: 1)'the need for pre- 
cise, efficient procedures that cdn be used in a public school classroom; 
and 2) pinpointing major disruptive behavior for frequency *tal Vies. The • 
teacher pinpoints a few (1-7) major disruptive behaviors and notes the 
frequency of occurrence for each behavior. ^The frequency can either be 
tallied for one hour a day on five consecutive days, or for the entire 
school day on five consecutive days, depending upon the teacher's pre- 
ference. 

During the revision of the observation procedures, it was noted that 
most refe,rred pupils have appropriate behaviors but they may have low 
frequency of these behaviors or they may display the behaviors at inappro- 
priate times. Therefore, in order to develop a complete analysis of social 
behaviors and social skills, appropriate social behavior movement cycles 
will be observed. These data will also be of value in pinpointing social 
return placement objectives for the pupil. 

All definitions of appropriate and inappropriate behavior have been 
revised and the social behavior observation procedures have been simplified 
so that frequency data can be taken by public school classroom teachers. 
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, New (Dateriah dWelj^ed for the Academic and Social Assessment Battery ^ 
On the basis of data co^ilected In .1972- 1973, Teafn II developed some new 
materials to be used in the Intake-Return-FbHow-up procedures. 

U The Screening Probe for the Acadefftlc Assessment Battery (SPAA&), 
the procedures developed In 1972- 1973 'tnandated that all Skills be 
; probed for five consecutive days even If the pupil was^ considered 
' to be at criterion level or abbve^'^or a specific skill. This 
seemed to be an Inappropriate use of time In assessing the^upJK 
In order to develop the* most efficient, precise procedures for 
administering the academic assessment battery, ther'e was .a need 
to pinpoint Individual skill deficits (for each referral) and 
then take data for'flve days using only probes for those specific 
skills. A screening probe for the academic assessment battery 
was developed in order to Initially pinpoint the pupiPs skill 
def ic^encles.' 

2. The preacademic probes for the areas of reading, math, and 

writing to be included with the original academic assessment ^ 
-battery. ^ . , 

Another ^area of concern, upon evaluation of the collected data wa^ the 
need for, probing pre-academ^c ski 1 Is* Although several referred pupils 
were in first or second grade classrooms, their skill levels were far below 
the skills Identified lathe Academic Assessment Battery. Therefore, . 
twenty-one addltiona.l probes were developed to probe the pre-academic 
skills (matching^ color dtscrlmlnatlpn, number concepts). There are now 
forty probes In the; academic battery, and only the probes designated by 
pupil's .score on the screening probe will be administered for five days of 
data. ^ ^ ^ ' • / 



i . ♦ . . ^'■^3 IV; Establishing jCrlte.ria PerfoPfhance Uvels. 
"Rationale \ • 



^ Robert Mager C1972) advocated specifying criteria performance levels 
within the context of eafch bebavloraf, objective! However^ the$e<.crlteiEja 
,most o^teLn^inpluded only a specif led level of accuracy of- perfqrmahce 
(e.^., flv:e^c6rrect^. However, the^ fluency wf^li which a taskf Is performed, 
4s«.often moreu Indfcatlve .of th^ level at which the behavlar has b^en mas'- *. 
tered,. For example,, a student who scores five torrect lo on6 minute has- . 
significantly more fluency than one wh6'takes one hour to scof^ five correct. 
Often; In fact, fluency, not accuracy,- Is. the' v^Vy reason the chlW Is. fn 
the reco^dlal program;^ ^n^e's hyper-actlve*,^* '^'s slow/! - Both fluency and * v 
accuraty together serve as Indicators of performance. A measure of each* Is / 
necessary "to determl ne performance on Wst of thp bastc ski lis. Teachers 
set performance alins* These jafms, or criteria, may be establlshe^d for 
•^evejcal reasons: ,# ' * , 

a. " to Insure progress on future tasks (as suggested by Bloom, ,1971); 

b. to Inspire maintenance of that ski If; ' ' 

c. * to Insure generalization to other areas; / 

• * * ' ' - i * 

d. to^meet peer performance T.evels, > \ 

^ Proficiency, on the .other hand. Insures. mastery oiF the tas1< .as defined 
by the parameters and objectives of the task*. For certain skMls, fSuch as 
spelling,- mastery may mean maintenance. For others, ^such as readl.%con- 
sonapt^^ouniils, mastery may mean success In the tool skill (reading),. 
However defined, proficiency tisvels must be s^t empirically, with large 
data sets tp assure reliability. Criteria le^ls may be proftclencyi . 
levels^. pr they ^y be relevant to a particular student only (higher or 
lower than proficiency levels), but fhey are usually set Individual fy. 
Since the common data type which can ipeasure both accufacy- (cbrrcct and 
error) dnd f luency (t6tal performance) Is rate, the^dal ly measurement 
system described ^throughout this paper has been the'basts for research Into 
both criteria and proftcrehcy levels. , • 

Team it Is currently Investigating commonly Used criteria and almi as 
well as methods for efficiently determining proficiency levels. 

Prog re$.s 19^3-1 97^ • ' ' " • ' 

, . Collection of alms . As an Initial step toward Invest I gat fng pro- r 
f Iclencyi lev61s. Team 1 1 collected criterion levels wblch have been set; for 
thirteen separate academic tasks. The almsiwere set In 'many ways: by 
estimate, proportionally, from normative data, and functionally. These 
alms were compiled* along with Infx^rmatlon about the, type and age of stu- 
dent, the type of materfal , and how the aim? were set. In addition, rules 



for tf^ttihg-alms were compMifti Incladlng rationales, pi^ocedores, exaqple^, 
j^tui captions. Xbe method/ explored Included previous pet!formahce; adult to 
.^^Hd*, prdport-ional datpf peer comparlson,/^unctlbnal analysis, norma^tWe 
data,' Intersection bf^a^known' desired data and desired 1 Ihc^^rogress, 
and perfoi^Tiance eel 1 Ing. . * \ * " ^, * • / , 

^ * r ' • ^ - ' • ^ ' * - ' r * ^ , • • . : 

*\ Flueiidy^as a component of criterfon performance , * One research project- 
was conciupted which attended to^ the Issue of f^luency as a component of 'per- 
formance by comparing acquIsltioTi and reten^tlon Undei; a standard requiring 
oftly accuracy.^to pne also requiring a des I red^Tlu^'ncy '(desired rate of ^ 
response). , V : . \ ^ - . 



' . f ' '* * • Accuracy 'Versus Fluency .Plus Accuracy , 

/ .^^ - j" Us£d as Criteria • „ , • ^ 

" ' „ '"3 Mathematics Program ' • ' ^ 

> ; ' • ^ ^ iestra M. Hazel * 

♦ ' « ^ » 

'■ v'./ ■■■■■••1 ■ • 

* ; . Two students of slmHar mathematical Ability were given Identical 

^ math sheets .In AddltloB.and subtractlop In ah attempt; to determine 
^. whether accuracy or accuracy .plus fluwcy wa^ 'moro-^irf fectlve when used 
as^crTtgrla In an ad^'u{5ition*-retent1&n situation.. Obe student was 
^re<<u1red t'o reach only accuracy criteria before moving on to the next 
level; the other student was required to reach fluency as vvell as 

' ^ accuracy criteria^- Post-^test results Indicated that the student ^ 
working to fluency plus accuracy retained more Information than the 

^ Student working sto acquracy alone. ^ ^ 

. . • • ^ f • ^ " . 

Number of^ days at criteria * Four separate projects attempted to 
ascertain whether retention was facllltateil by requiring performance on 
different academic tasks. at a desired rate for several days rather than ^ 
only one day |i>efore mpying to a subsequent task. Data from these projects 
are Incbncluslve^at present, "but the Injtlal data seem to Indicate that ?he 
number of days a child Is required to perform at a desired rate does*^ 
Influence the maintenance of that skill. 



Investigation of the Difference In Maintenance R^tes 
- ' - * on Reading tists of Puplls'hteld to Criteria 
f for One, Two, and TKree^ays 

Lynette Taylor*' and MarU Eaton^. . 

) ' - ' " ^ ^ 

The effect on maintenance of holding a pupil "^^rlterla on a 
reading list forgone, two, or -three days was investigated J n fhls 
study wlth^two boys, aged eight and eleven years. . The material 
consisted of teacher-tqade lotto 'games and sl^ five-word, random or^is^ 
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. ^ ^ J • . *R i • . 

reading lists per pupMVrawn from the Do4ch#word nists, pCeprimec \ 

througfh "second reader. On* l ists I'A^and flA the pupi ls werd held'^to 

thfe* criteria of fifty correct responses and zero -errors per ffilnule for 

ohe/day, pn lists and I for t^o consecutlv^e days^rj^and on IJstsJC 

and lie for ttjree consecutive days.* ** • . ^ * J : 



Lotto game drill always preceded 'the timed reading Ust.^ T|i^, • 
fujpHs wfere tested on three lists dafly, o^^ach- f rom groups A, B and 
C, .|fhen Hie pupil met cri terla. on any one Tist, that lis^ was 'shifsted 
to a Maintenance phase. Maintenance testing occurred once weekly. 



* The resul^s.from'subjeftt one'^ata inditcite that in, terms of 
accuracy, maiVitehance rates ,were-be$t when the f>upil was held to 
criteria for two of*- three days before/ente(;lng thermal ntenance phase, 
a-1 though longer acquisition pl?as« were required for t|ie three day 
critefria. Subject two's datd indicated that the maintenance phase 
scores^ were simil^ir whether the pupil was held to one-'twb, or three 

' days, at qrl,teria^'^ although three days required' longer acquisition 
phases. ^ ^ ' ' ^ ^ ^ , , ^ 

^ ' ^ . '' * " ■ ' r ■ 

' . .A Pf^ectyto Investigate Acqulyi tlon and Maintenance , 

• •' • ..of Spelllnq Words -by Pupils .f 

' . Hejfl to Criteria f<}r Onpy .Two and Three Days - , ■ 

r \ Mary Jo Hedgjps - / ^ ' ' • 



^ / Themairt purpose 'Of *th Is s'tydy was to ascerTt^fn th^, optimal - 

• i^umber of/ dayjs a, ch1 Id^should perform at criteria on spel 1 1ng wprds in 
order td achieve mafjr^enance. Two subjects, aged' nine and t^rt, were 
hi^ld to a/ cr'l terla of 1 00 percent ^accuracy *over one, two, and three 

♦ days for separate J I sts of words- AfteV the subjects had met cri- 
teria, a second gpari5f *the research was. to examine, the ank)unt**of 
genecal izatJon in liftter patterns to Ijsts of sim^lar\vards. The 
.results tend to indicate .that three days perforrrance at criteria may 
be desi r^ablefor maintenance. With regard, tc/genpral Izatlon, it 

•appears that in some lnfetanj^^^thte< subjects drd generalize spelling 
patterns to^lTsts of simHSr^Words. However, due to the. bri^vlty of 
the maintenance, phases 'and* the vaf-labJ 1 1 tv. of data on^ the generali- 
zation lists, further reseai^cf? Is ne^aed ^or conclusive evidence. 



' - ^ ' ' : ' -.18- ' / - , • 

' ' . ' . ^ ' * ' , ' ' ' . . • ' 

- ' An Investigation of i\}e Differences In Majntfhance* 

' ^ , Rates on Spell I o& Probesi l/hen*Hel<J to Crltisrla^ 
, , • * for One, Two, or* three C'on'secut*h/e Days ^' 

* * , L . . ••'^ ' ' * . . ^ , ' ' 

^ Terry ^lyan^ 'Sandra Smelser/ and Harle .E'aton*^ t . > 

^ • The objective of this study was to detefmlnelthe effect of the 
number of days at desir/i4 rate on the rnafntenance of skills. Three^' 
ie^rnlhg disabled bcj/s^'aged nine, were given three one'^lnute spelling 
problems of six yords each day. ' The only difference In procedure 
betw^en\ the probes was. the^nurftberW' days fequi ried- at , criteria on the 
words. 'Oh one ifst, one'day at desired rate w^^s^acceptable. Once .a ' 
pup H had met all the .criteria fof pafssing e pnobe, he was given a, 
maintenance test on those words the foI,lowtng. V^eek and edch week 
.thereafter throughout^.the project's duration. Jhe'flata Indicate that 
best resiilts were obtained when the boys, were t^Sjd 'tp crlt-erla for two 
days,.*ln tentis of mair^tenance'of correct anfd error rates and covering 
mat'6rlg1 In a reasonable len^th of tltne^» * ' '- ' -% \, 



0 raff ft ^ 
of l^equl^ng One> Two, or Three 



The Effects' on OrjaR Reading Rate and Accuracy ^ 



Pays- Cri<terfa Perfor^nce on a l/brd List 
Kathleen Terry, .Cfiuck Vel lleux, and Marie Eaton 



hi this study two variables were Investlgated^f Jrst, the effects 
on or^l reading-rate In context of reading Usts or the words cotk- 
talned in. the story;' and second, the effect of the number of days at*- 
dj^sired rate required 'on subsequent reading r^tes and maintenance. 
The s«bjeat,was a twelve year old moderately retarded child who was\ 
reading .at, a preprlmer level. Three sets ^>f word lists wfth co^re- ^ 
spending stories wer^ .devised. A desired rate of thirty words per 
minute (wpq) with zero errors was reqgl.red on cfach word f ist before, 
the child b^an reddipg the story which contained the words* A 
desired rate of sixty *wpm' correct witft one' error or less w^s f^equired 
In the story before the- next word Ufir.ln that set was Introduced. On 
the' iFlrst set, .one day^'at criteria w^s ^considered sufficient for both 
•the list and the story. On a second set, two days; were reqblred and 
on the thlr4.set, three^-days at criteria ^^er'e necessary before moving 
to a new^llst or story^ ' .\ * ' . • ' 

V ' • ^. ' ' • ^ ' . - * 

^ The data Jndlcat^that two days'at criteria produced better 
performance In terms of consistency of response, number of days 
required to meet criteria, and malntenanqe** 



\ 



t 



• Accerertttng versus stable aim's . The educattopaj'- progression their 
students is of Jmmediatfe concern to most teachers* •' they are always searchin 
for methods which will, maximize the work capacity*-of each ghUd within the 
classroom so that educatloTnaf. progress for' each child becomes reality.-' ; . 

Reinforcement procedures' fiave been suc^essfuj^^ln motivating many 
children to Increase their work output &nd quality 'tCotter & Spradlln, 
1971; McKenzle, Clar|c, V/o1f, Kothera, S Benson, 1072)/ Others, have exa- . 
mined different schedules of reinforcement arid . thei r of feet on pupil per-' 
formance^ (Levitt .& Esveldt^ 1970; f<lrkwood, 1971; Hansea,. -1972) / ^ 

A ^number of these Inv^ti gators, however have no^ed th^t Jn some', 
cases the chi ld' s, performance level tends* to appi'oximate the "contract rate 
or lev.el at which he receives re I nforcemCTT^lynch, 1972)1 'Therefore^ .this 
study was initiated in order to exf)lorfe pup! U^ePfonnance under st?b1e'*7 * 
versus accelerating contract a"ims.. ^ : *• t 



The Effects of Stable ^Versus Acceliratlhg 
Contract Rates 'on Hatl^r Performance, , 



Valerie Lynch 



Jn thls.s^udy, the two subjects, aged thirteen and fifteen years, 
were rel nforced' f or rates j^quall-lng 6r bettering ^ previously estab- 
lished /iJ^s i i;ed liiae of progress; In' math. • Therefor'e the puplPs 
contract /rate Increased cl Ightly each day. This procedure, was con- 
trasted with the rftore typical stabl.e contract rate phase. 

The results of this study are confusing and contradictpry. A. 
- " great deal^of variability was ^hiblted by both subjects during each 
' phase of ' the experiments. Subject A's highest median rate occurred 

during a stable cont^ract rate phase, while this dta no£ hold trOe for - 
Subject B. '^uoject A exhibited a higher mean numbe^r of errors during 
accelerating contract rate phases white Subject B did not* -The 
; . .shortest anjount of time to reach'crlterton*' occurred during ari accel- - 
* eratlng contract rate phase for "Subject B, biit during a stable con; ^ 
tract rjate phase for Subject A. Taken'together, the data do no^t' 
• * support the* superlori.ty of one type -qf contract system over another J. 
A number of problems are evident within the. study which .deserve* ' 
discussion. . \ . 

"The contingency schedule history of both subjects was simi lar*. , 
Both Subjects A' and D had wo.rked under a stable contract system before 
this study was initiated. .Neither had previous experience with the 
accelerating contract rate system. , Tk^ fact that both had pf4-exposure 
to one typ^ of contract system but not the other may have 'contaminated 
the results. * ' . ^ ' 



/ '* The great variabUlty In data during "stable cont^att rate phases. 
. .points to the possibiifty that tHe arbitrary decision ^$0 xhoose 20.0 

responses per minute as the st£U>le contract rate-inay han^e been In 
^ error, . Jt Is profjable that this rate was far below, the subjects' 

capabilities and therefore not challenging,." 

' ^ .Finally, the addition of a third Condition dTssHnllar to the • 
accelerating and stable contract rate'systems ma^ have clarified xhe 
results* Both the stable and accelerating contract ratesystims ' 
consist of a single line which defines performance, as "gopdV or **Jb^d/* 
Kri other. words, under both syst^gis a specified rate is set and per- 
formance falUng below that^ rate *l)s not. reinforced. The only .diff fer- 
ence between the systems Is the angle of the line of progress which 
determines which performance is reinforced ^nd whi55fr^ts not. , 

Because of problems Inherent' in this study no conclusions can 
drawn as to the comparative efficacy of the cofttract\rate systems 
under consideration. However, In^a tl-me when educatjiyfal account-*^ 
abNity Is becbcaing a reallty,tlt!b Is* lm[iortant to provide teachers ^ 
with tools &nd knowledge which wilf aid in promoting maximum per^ ^ ' 
fdcmance of all children within .th^ classroom. The research which 
eiSclsts oft reinforcement schedules In the classroom suggests tn^t .with 
good research design, control, and larger samples, th fs. area tof study 
could provide vafuable Information to the classroom teacher concerned 
with th4 progress of^hls pppils. * ' ^ 

*• \ . ^. ' * » * ^ * , 

A discixminate analysts procedure fdr the emplrjcal determination of 
proficiency levels .^ The collection and evaluation of d^ilymeasu recent 
data^ on the" performance of pupils allows us the opportunity^ to Individual- 
ize Instructional programs and procedures to meet t^e n^eds o^ each. ^ . * 
letting performance criteria Is now a best guei^s proposl'tion; errors prow;- 
costly in temis of Indlv^iduaJ stuc^ent performance time. Prpffclency levels 
would provide empirical bases from which to begin productive fndlvldua^l izati 

• In order 'to, set empirical performance criteria we need' to coMfect'tJata 
on d;large. sample. During- Autumn Quarter, 1973, Team H qol lecfed dal ly^ ^ 
data ^n larg^ numbers of pupils. ,The projec]£ Is now completeq, and althougf 
*the analysis of the data has been both time consuming and difficult, we * 
have found that a modified dlscriml-nate analysis procedure can provide 
prof iciency ''levels. . • • " ^ . 

^ A Discriminate Analysis Procedure *Tor the 

* ^ ' Determination of ^Performance^roflclency 

Kathleen Liberty, Owen White, and Cprky 'HcGuig^n ^ * ' 

, • ' ' *' « , 

^ Data were collected on the performance of^orty-one subject? for 
thirty-six days. Subjects sorted cardboard shapes into>oxes for a 
one-minutt period dally. During the first phase, the subjects sorted 
^ \t*wo shapes;' the number of shapes was Increased by one during eac^ of 



the sucreedlng three phases, Th^ls skf 1 Is. sequence *w^s constructed to 
resemble a skill hierarchy, used, for common educational prt>grams. The 
daita were used^*to test anal 1 5 procedures ajseful fn the determination 

'of proficiency pe^^rformance levels. Eleven trials w^re requl,red to 
4efln^ rules for pcedlctl'ng performance and prof Icl-enc/ Idvels, The ' 
numbeV of trials, of analysis weref large, however, and could be reduced^ 
through, a more precise definition of the variable Important to the 
skllK However, the uti.llzatlon of a modified discrl.mirtate Analysis 

^procedure for ^e detercifl nation o*f proficiency levels' seems to be a 
promising method/* further sXudtes using a larger computer ylll deter- 
mine the efficiency of the dgta. "Future studies ln«pwrtlch proficiency 
levels are evaluatedjjwi thin- instructional ' programs vvil 1 b^ necessar^y 
to check the accuracy and application of proficiency levels determined 
thK>i/gh this method. . ^ ^ : , , 



*- • \ • ( 
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Area V: Instructional Procedures 



Rdti-onale 



^ When , the body of literature on traditional Instructional procedures jff / 
. reviewed. It becomes clear that many educators use drill, fading, cues, 
prompting,, practice, of other procedures on the basis of the recooimendatlorfs 
^ of experts only. The literature hks, little empirical evidence whJch ^uppor.ts ^ 

the use of these, prqcedure^or delineates how or v^hen they shotgd be';(ised. * 
- ^Therefore, Team II ha*s inve^gated some of th;ese procedures using appj led . 
behavioral analysts methodology. , ' ' /; ^ V 



4 



\ Progress 1973-1974 V , ^ . . - 

> ' ' r ' ^ , ^ \ ' . ' ' ^ : ' 

il>r 1973-197'* res^^arch was done In several ^areas: drllf practice, 
"^jompt'lhg, feedback. Whale-part learnings and cues^ The following Section 
^summarizes the research In each area. . ^ . 

' ' - <.^^^^ /' ' •\ ^"W' ' ' 

Drill * ^ Drill hasL long been used^especiallV by teachers deal^g with 
learning dlsab.led ^children, as ^ metfiod.for Jmprovln^ ch I, Id ren • s' perfor- 

• mance.on various learning t^sks. Reading specialists such as Gates (19'»7) 
or Gray (1956) often recommended drill procec|ures as a met^iod^ to Improve 

* reading performance. i ' ^ 

Earjy researchers such as Hebb ^nd foord (19^5) :and Thorndlke (1932) 
working In the; fields* of acquisition, fete»ttion, generalization, m6dellng, 
\^ and active responding all dealt w.l ^h^ component parts of'^he drill process, 
yet 'ihere Is llttl^ research In classroom settings whyih reports the 
functional' effects of drill on academic performance. 

* • • ■^^ * « * 

' A number of different modes of drUI were Investigated this year. In 
\ \ one study, routine drill was Investigated as. an Instructional procedure to 
teach slight vtords to two severely hapdlxapped pupils. . 



The Effect of Flashcard Drill on OraW 
identification of Social Sights Vocabulary 



ERIC 



{Kathleen illbert^^ 
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Two severely handicapped boys enrolled In the secondary classroom 
at the Experimental Education Unit wefe sflbjects In this study, which 
was designed to Investigate the> effect of f lashcard^tlrl 11 6n the 
mastery and maintenance of social sight >>ocabul9^ words.. These words 
were those assoc!ated'with a **necessary*J soclaj> sight vo9abu|.ary, and 
Included such words as "danger,** **polson,** an^ ''keep out.'^OrOrlng the 
baseline phase, the subjects were given a list of the fweniy-six 
different, words* They were timed for aJ one-minute period as^they r^ad 

' •■ ■ . >.-■>' 

)•••••. ^ . , , 



the words. Qurlng the Intervention phase, the teacher presented the 
flashcards Individually to each subject, the teacher and the- Subject 
read through the flashcards three times. (One word or phrase was 
printed on each bard.) Following this short drIM, the subject was 
given the sheet and asked to read as^ data were col l^cted for one 
minute. This phase was terminated wh^ the subject read words at or 
above about fifty cbrrect per>mlnute with two or less» errors for two 
consecutive days. The third phase (maintenance) began approximately 
one week after the end of the' f lashcard phase. During 'this phase, . 
data were collected once a week for one minute as the subject read 
from the sheet of words. Both subjects were performing at about five 
correct per minute during the baseltrie phase, with having a median 
error rate df thirteen and S of six. Under the 1^lashcar$l drill 
. conditions, both subjects maae rapid gains. reached' cr I terl on In 
eleven days, while J" nine. S*s median ^performance during 

the maintenance phase was^ forty-nine correct wJtH, two errors while 
S2*s was fifty-seven correct with three errors* per' ml nute. For toth 
subjects, routine drill with the flashcards accelerated correct per- 
formance, decelerated error performance, and resulted In adequa,te 
retention of the words. Future studies will examine conprehenslon of 
these words, and transfer lo *'real** situations.^ 

Four studies compared routine versus novel d.rll.l as a'n InstrujCtlonal 
procedure: ^ . .C' 



Four Studies investigating the Effects 
of Routine and Novel OrlU on the 
Acquisition and Performance Levels . » 

of Learning Disabled Pupils ' . 

• Corrlne McGiilgan ' 

. .^..^^ — 

STUDY I; The effects* of routine and novel drlfl on the acquisi- 
tion ra.tes of twelve pupils learning- the manual communi- 
cation alphabet. . ' ' \ 

Study I was designed and Implemented to study the effects of-^'\ 
routine and* novel drill on *the acquisition rates of twelve pupils 
learning the Manual Cpmmunlcatlon Alphabet* Four groups were 
formed with three pupils In each. Two of the groups were drilled 
routinely (I.e., with the same materials and in a consistent 
manner) and the two.others received noverdrill (I.e., varying 
Instructions and varying techniques), in addition, one routine 
gnpup and one novel. group recelvedCin forma clonal feedback (I.e., * 
they were told after each session the number of correct and incor- 
r^ect formations they had madfe). 

^ *i » * " ^ » 

The results of Study I indicated that the effects of routine 
drill with feedback were superior to, the, effects of routine drlU 



wlthdtfTfeedbafck and riovg^^ri 11 wlth^^nd' without feedback, for 
sludents leiarning .the manual communication alph>b^t/ The^Une of 
^progress ^Fo* Correct, resp6nses *for Jtwo of three pupils hi .the 
routine with feedback group (Group 0 proved to be considerably 
greater than those *of pupl Is In a^y of the other three groups.^ 

The errot rates* showed nq greater. or lesser' 'celeratlon 
patterns, using* i^ut I ne drill techniques and feedback than any of 
the Other groups. ^ i \ 

Malntenaftce dhecks also revealed that wHj'le Group I (routine 
with feedback) dropped .the farthest' from end ratej they did not 
fall below what others iiad achieved, * 0 

\' . A / \ : ' ; . * - • . - r 

f When Groups 2 and 3 are compared^ It should be noted that, 
aga'ln, routine drill without ^feedback shows si ightly greater; 
acceleratfpn for correct responses and greater deccfleratlon iFor 
error responses as cornpared to novel drill without feedback. 



^^S^iyOY* 1 1 :,The effects of routine and noveT drill on the acqulsl** 
« , tlon an.d pei^orinance level pf a stident learning the* 
manual communication alphabet* 

SOn^ pupil was chosen from the routine dpill-no feedback proup 
of .Study i. 'An A-B^-A- design was Implemented to ascertain .If dif** 
ferent\di^Ml types produced different performarices once the pupil 
4iad progressed through the acquisition stage of learning toward 
criterion levels. The pupil showed a slightly lower trend In Phase 
2 (novel drill) and again in Phase 3 (return to routine drill) than 
he had In. Phase I (routine drfll). It should be noted that the 
median score? were progressively greater In each phase, showing 
continued progress* by the student. — 

As for error responses, there '^seemed tp be a detrimental 
effect whep novel drll.l was Ifitroduced fn the second phase. A 
decelerating error: trend occurred when routine drill was reinstated 
In Phase 3* This Increase In error responses during the novel^ 
drIU phase supports the hypothesis that novel drl.ll may Increase 
%fr6r responses when the^ taste Is not at a criterion level. This 
••hypothesis l^s also^suppcfr'tediby the findings of the third and 
fourth studies In this project. > 



STUDY III: The effects of novel and routine drill on the acquis- 
tlon' rates of a pupl4 learning to form man\ial communi- 
cation symbols. ( * . ^ . 

The results .of this multl-hasel Ine study Indicated that the ^ 
p.i^^Il who had attained a high, line of progress .under routine drill 
conditions when learning the flanual Communication Alphabet pro*' 



gres^etj well under novel drIW when le^tnfr.q the^symbols for rnHn^Bl 
communication (a sfmilar but more me^nlngfuJ task than the HanuaJ ^ 

; Communication Alphabet). However, data polftt out that errors weVe 
at a higher r^e-|n ^he nov^l d'rl 1 t^ondltfons than In. routine • 
tJrlll (supporting studies 1 1^ aml/lV)w' Thfe probable /edson^ for- the 

.. change in' effectlyeness-^^^irhe dri types In this study are thk 
' le^^Ql of meanlngfulness of .thiet materjal, and 2) thp close Relation- 
ship bet^en this 'task adfd itfie one tAught directly preceding It/-* 



STUDY IV 



f^-Th^ e/fects of noyel and routine dri If on^ the acqbtsi- , 
ti,on,-and performance level of a student writing numerals^ 
pnfe through one hundred. 



Atjgin; a multf'^baseline^ typ^ des^ign was used^ for'cross comr 
^ pari^on of data. The results show that routine and-novel drill 
; wef e effective' In Increasing correct rates oh writing numerals I- 
50,.>^th novel drill showing slightly greater accelerating Ifnes of 
, progh^. Both novel arudYogtlne drUl were also effective In 

redMclnJi the amount of error responses, novel again having a 
, s^i^1Jht5y^iJreater effect. . ' . ^ , ^ 

Routine ^rijl did result In' Improvement In performance wh?n' 
the^pll was'asked'to write numerals. 51-100. Outing Phase I . 
(novel) a previously decelerating pattern changed and errors in- 
creased considerably. Phase -2 showed decelerating patterns of * 
errors In both novel and' routine drfll. sessions, routihe having the 
greater ^rend deceleration. i . * . * 



• It shouljd be pblnted 'out tliat.for this pupJl^^da 
' nqmbers 1-50 during his regular* In^class ma^h session 



dally tlrlll .on 
, I on may' have ♦ 

Influenced the results*. 



The effects' of new versus errof^word drill vJeVe compared in tivo studf es. 



A Comparison of Mew versu&'Err9r ivord Drill 
^ * on Reading-Performanfie 

* ** 

s Marie Eaton and LueJla "Halsch 



ApplTed behavior ahaly.sjs techniques were used ^to assess the 
Influence of two types of word drill on the reading performiincc of 
siic primary age ^learning 'djsabled children: drill on ^ew words and 
dr^y^n'on error words. V * ' * 

' The data Indjcate that drill Is an effective procedure t^ 
Impf^e , oral* reading perfortpance and. that for most children djriil 



/ ' ^ 

* on error- words Is superior to drlll *on' new vVords In terms of 

' acc^1era5l.on of correct rate and dteceler^tlon of errprs. ^ ^ 

* - " I* , ^ 

* « *■ i 

Furthemtere^ the' data M lystrate how teachers^ cap. use^ appl ied • 
^ 'behavior analysis methodology tb, seject' the mostf^ appV-oprfate 
teaching procedure for the children lit her clslss,* ' 

■•/ ' <, • ' 

, . - . - «. ^ I 

The Effects of Hew versus Error' Wbrd Drirl , ^ 

K .on the Reading of Ifecipe Car^s 

' ; ■ . ^ ' \ s ' ^ • V. 

' * • ^ > It''- Maria White/ • ^. ^ . 

.1^ ' / // . ^ — . 

DrlJl on neW verCus error w<Jrds Were compared as" techniques .to 
teach sight word^ necessary to read/S Imp leered pes. For this* thirteen 
\y'ear old subject botri procedures , proved, ecjua 11 y effective In: reducing 
errors. The'author hypothesized tjiat tHese results, were evliient 
because the pupil's Errors were lat^gely M n the preflxor suffix 

V fJorttbn of ^rds and wou"ld. vary, from .day i to de>^. Therefore It Was not - 
tlje drlM on specific words.whlch provpd-e.f f Iclent but the drill 

^, procedure; ' Further data are being collected with t'hls sujxje^ct to 
determfne If'dijlll on and aj^tentlon to pref J^xes ancl. sufl^txes will 
Increase accuracy. ' . ^ ' 



Another area of drlU explored this. year was the effectiveness of 
massed' versus distributed drill. For a wide variety of \f asks the question 
has been ^bsked: Aref^loagc^ term drlll'sesstons or numcroiis shorter drill ^ 
sessions more beneficial tojjearnlng* p6^rformance7 To explore thl^ question 
exper^ment€^rs Jtaye conducted ^s^tudies* deal I ng directly with massed and 
dlstrlbyt^ tr^'nlng (AusUfbel, 1969).. .4 - , ' . 



Massed training Is-deflned as a. situation In which trials are given In 
rapid succession wljth a minimum tln^e. Interval between each trlai^. Oh the \ 
other hand, distributed training' Is a sl4:uatlon In which some longer time ^ 
Int^rya^^^, a 1 lowec^* between -eath trial. * 



\ 

\ - 

' ' ' • ■ ■ . ' ' 

An Investigation of Pupil Performance to Determine > 
"the Effectiveness of Kissed versus Distributed Drill , 
^ In the Acquisition of Beginning Matii Facts , ' ' 



Chuck' Vel 1 leux 



This^fxrojecl* was* concerned with the acquisition of 'basic math 
^facts anH'^whether massed or distributed drlll.woulil produce the bisst 
acquisition of these skills for an eleven year old retarded boy; ' 



A multiply baseMne design was^used to investigate these drill 
, methods. Procedures were^ identical for both conditions except that 
the math ^cts to be learned for thfe massed condition were presented 
In one fi^e minute drill session, whereas the facts for the distri- 
'but^d drill wefe preafented In five one minute drill sessions spaced 
throughout the day* . • 

• Analysis of th'p lata provided In- * ^/e results. The pupij^ 
iva? exposed tq mdr^; material with me . > however, performance 
• was itore consistent across phase's fo. .ts learned through dl^trl- 
* buted drill. «lt{>5 impossible, to general ize from 'these results. The 
. >{tetjatufe;(pn masSe*^ersus c^^slrlbuted drll 1 * supported the distrl- 
'6* ..'^"t^d approacl? bec^seM6arnlnlg[^£fenerally occurred at a faster rate. 
^ \ln this study., less material was. learned, But performance was more 
^ consistent ac^o|5 thephases with- a distributed approach. 



./ /; . ■• • 



• • /^*area of concern closely; related to the 'jnassed-dlstrlbuted drill 
Issue Is tHe wholWj^art l^a>ni4ig Issue. A: -* 

J ' ^'^^.^j®<^^'v^^^"*"e^^rly persons committed to the profession of 
teachlng^fs tq pptovide the best* curriculum, and Instructional procedures 
possible for their pupif?. To meet this objective, research Is often 
desjgned anjl tmple/h^nf ed to Investigate which .Instructional or curricular 
^.yafd'dble rs most effective In aiding the leiw-ner. For many puplU, this ^ 
- mea?^s presenting the materials wUh contingent- positive relnforcers or 
•/presenting the matter 1 51,1 In various revl'sed forms. In different tlmejnter- 

0 -vals,*or In v^fylhg amounts; ' !. St 

l\ s This Ititter teaching Intervention » presenting mateVlal 4n varying 

amouni^Sv Is technlque^bften rfeferred to as **part learning*^ which Is In 
• direct contrast ;to 'Vhote learrtlng." Whole learning means that the mate- 

1 rep^ate.d as aHfhdtfr^f r*om beginning to end at each trial: until 

/ the ):rtti6rlon Is reached (twentyxspel liJig worlds are presented at once). 

V* P^r^: J earning, however, refers td the technique of dividing the material to 
.be4-Ieahrned or; activity to be p|trformed Into parts (fouf' MnltS wl^fi five 
woi^d^; in each unit) which* may TSe practiced separately and thfen^ combined In 

^ a nwnber bf wayg' to^ reform^ tlie whole (McGeoch,^ 1931). 

; T^ question of whether^ pupils function better wfien Instructed by the 
wfiple method cn*^y'some form.6f. the part method hd^. stlmul^tec , larg^ , 
y ajnoun^t of reSsearch. The studies are, howeyer, usu^iily lacking In empirical 
• data. and often raise more quV^lons than. they answer. The following pilot 
stLdjef^W.e^e'Beslgned to^eniplrJcal ly ascertain If certalrT'chl Vdren. might 
perform better when the material they ar€K,reqai red to' learn Is- presented In 
' ^ parts/rather than In- th^^tradltlonal Wh6ffe> > j 



Whole-Part Learning 
Corrlne McGulgan , ^ 

. 'Two pup Ms, a boy «dged fifteen and a g?rl aged ten, served as the 
subjects for a study to assess whole versus par£ teaming. Both had 
been referred to the Experimental Education* Un I t because of "academic 
deficits jand Inappropriate social behavior. 

Spelling was the subject area chosen^to Investigate^ the whole- 
part Issue. During one condition the pupils were presented with a 
llst'of words to be learni^d. ftal l^y qulzzes were given on the words 
* and the pupils were allowed to move to a new list when 100 percent 
accuracy was achieved. During/the second condition' a similar list of 
word<>'w^s presented to the student,, but Instead of the whole list, 
only portions of the list Here presented at a time, - l/lien each portion 
was learned ^o 100 percent^ accuracy the* next portion was Introduced 
until the entire list was learned.^ 

The data supported the hypothesfs^that during part learning 
periods both students were m\e to perform better than when the 
material to be learned was presented as a wholes 

Putting aside empirical data fpr_a mortoent, the author wishes to 
polht out a few observations which were not recorded 6r charted. For* 
both p^pMs, who often refused to work,^.part learning was a great' help 
In curbing the obvldusly unpleasant attitude toward spelling, they 
of te^' commented that only two or five words per day was really not so 
bad.! It seenis possible that such a change In attitude mi^hf also 

.account. In part, for' the higher scores during the part learning 
condition as well as for the relatively low scores ddrlng the whoi.e 

- learnltig condition. Certainly, this attitude , whether It Is feelings 
of success which spur success or not — Is an Important variable for 
consideration by all teachers. ^ \ • 



Uhat seems Implicit In this study Is the fact that students have 
^optimal levels of performance. ^For some students, not as severely handicapped, 
five words, ten words, or twenty words per sesslof^ are tolerable amounts 
and will result In dieslred performance^. It 1^ necessary for each teacher 
to discover the performance levels of each pupil. Does the pupil function 
better wKeh the total- list. Is presented or when It Is .^resented In parts? , 
What Is the opttnHim len^th^f each part and of the whale? ^ 

' Currently, research Is being conducted In this ar^a whlcfi not only § 
deals with optimum levels of performance and the ques):{on of whole versus 
part learning, but also with the most efficient types of part learning 
(Progressive Part method, Repetitive Part, method, and Pure Part method), 
and the Immediate arid long term effect of each on retention. 



. Another type'' of whole-part learning might be to have a child "learn 
each separate skill involved in a task before learning the whole task. 
Of ten \./hen- 5 child demonstrates an inability to perform a whole task, the 
.teacher will select components of the task ;to be learned, before the whole' 
task is reintroduced.' The .fol lowing study explored the effects of re- 
quiring performance at criteria on a component part of a reading task on 
the child's subsequent performance of the whole task. 



An Investigation of the Influence of Reading * 

Word Usts^ to Criteria on the Number of Days 

'Wecessai*y to Meet Criteria In the Text 

. Ingrld.von Christlerson and^Marie Eaton . 



Many teachers' request pupils, to meet criteria on a wojd list 
- before reading-' these words. In context. There Is little data, however, 
which empirically supports the use of this procedure. This study 
^ Investigated whether' reading a word list to criteria v^uld increase' 
oral reading accuracy and f luency or ^affect the number of days re- 
^quired to meet criteria In the text. * During each day of the Initial * 
phase thejpupll, a twelve year old learning disabled boy, was requested 
to practice the words selected from a story-ln his reader until he was 
able to read them at a criterion level of thirty wpm wf'.S one or less 
^!^^^^^* 0"'y tfien'd^d he read the words In context. In the 8 phase 
the word list and the corresponding story were both presented each day 
until criteria were met 6n both. The second procedui^- was superior ' 
both in terms of fewer number of days required -|o meet criteria and in 
terms of correct and error rate on the stories. 

, \ 

/ • . 

Summary of drill research . In the past two years several studies were 
conducted^'lnvestigattng the effects'of drill on academic behaviors for 
mildly and moderately retarded children and children labeled as learning 
disabled and 'emotlor^^l ly disturbed. Some general conclusions ma.y be drawn 
from these drill projects taken together. 

Performance under drill conditions was superior to ^ 
no drill. 

Requiring a child to complete each day the drill exer * 
cises on a word list to desired ratp did not always 
result ih sljperlor performance' In reading when com- ^ 
pared with drill with no desired rate criteria. 

Drill on error words was generally better than drill 
on new or all words In Improving oral* reading perfor- 
mance. 
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^, . Dril l on new wo^^ds was generally more' effect! ve In ' * • ^ 

Improving' correct ah^ 6rrQr rate on reading words 'In 
context than drill on all'^wordsr. 

5. .Divl,ll on randoitily selected words did not produce the * • 

. / • same gains In oral reading ^performance as-the. other . ^ 
types of dri 1 h * 

-^y6. RoiJtlne drill produced better gains o^ several learning . 
^ 'tasks durlng.-^quls^lon phases^ than did novel drlllor 

' 7. Once accuracy was achieved, novel and routine drill pro- • 
• ' duced equal gains In rate on .spelling, sorting, and 
manuaj communication; tasks* 

8,, Self-directed drill produced ga I ns^ In accuracy, but not 
' "In flXiency on mathematical SKKlf sheets.^ • 

Teacher-directed drill produced better gains than s<5lf- 

dlrech^d drill Tn terms' of fluency. " 

.t 

10. When feedback of results was gfvcn wltl^ drill procedures, 
performance generally Improved more thafn If drill was 
given without feedback. 

11. Both massed and distributed .dr1 1 1 p^rocedures resulted In 

Improved performance> but tliedata did not strongly. suppor4^^ ^ , r 
. • either. ' ^ • '^^^ * ./ 

^ 12- Part learning was .superior to whole learning for children. 

with previous histories of Instructional faRJur^". - ?VHf^ r ^ ' 

, ^ V / - 

Practice as a means of Insuring retention . The J l^Jt^^ratur^ W ^the 
nature learning has concerned itself not only wlWAjjV^^^ .\ - 

what learning Is, tJ|4 also on the best methods, ^fy^^OT^g tItSt lear^^ng 
actually occurs. Once a skill has been learne^, next^^bncjern ot 
educators Is the retention of that skill. ^^^-3^4^ ' - 

Both drill and pract4ce have been advocated to^faclllitati^ ski 11 
acquisition and^ skill maintenance. Howev^^, most authors' fal 1 to^pro 
cedurally dlstlngwlsh practice from drill»> although ^ funcf|opal 
.definition derive^ from the research can^e'jt^de. Ortrt^ls^the dlrfected 
repetition of th€ specific response to be Jeafhed. Smith (1973) fi>r 
example, directed the subjects In dally drill over IdentTca^^fnaterlal 
untij the response was acquired to ^crl te^lonf* If the re^onsefto^ ^ , 
2+1, 3+1, 1+1, etc., was to be learned, J^hat response was drjned. / 
During practice, however, the learned response Is utl 1 Ized Tn, solvl^n^ ' 
problems requiring that response as well as others of a slmf lar ^o^**- 
dissimilar nature. If the response to +1 problems has been iacqulred,- 
the subject might practice that response by solving mixed add fact 
problems, 3+1, 6+2, 5+0, etc., or by solving problems requiring 1 f 

different proce'sG::3, 1+1, 7-3, 8x6, etc^ This distinction of practice , \ 
from drill Is supported by-Travers (1967) . ^ * 
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Such distinctions, as well as the r*esults of Investigations^ Into 
retention, are Important to the classroom teacher who must daily deal with 
the problems of forgettfng. A, common kklll area In which retention Is 
cruct'a\ Is spelling^ since the spelling of each wprd must be Individually, 
maintained. The spelling response Ig not primarily a building block, to 6^ 
utilized In other responses (as 1+1 Is utilized In '123+123). The study 
examined the effects of practice on the retention of spelling worlds learned 
to criterion.* " . . 



The Mon-Effect of Practice on the Retention 
of Spelling l7ords Learned to Criterion 



Kathl^een Liberty. 



The\four Subjects for this^study were enrolled In a secondary 
level classroom at the Experimental Education Unit. '}SubJects 1 'and 2^ 
were fourteei^. years of age, and Vo^klng on^spelling matorial at about 
the third grade leveK Subjects 3 and h were thirteen years of .age, 
and beginning spellers. Subject 1 was the onjy girl. 

Each subject was given a list of , words to* learn. ^ Once the words 
w6re learned to a previously set criterion level the maintenance phase 




were given to all subjects weekly for the rema^ncW of the study. All 
subjects maintained' at or near their prl-terlbn rates. The data 
Indicate that practice has little^ If any, effect onVetentlon uf * * 
" spelWng wh§n those y/ords are learned to a. criterion level. 



' f ^ Pjymptlng and Feedba ck, ^tost of the progt*ammed materials whldh have 
fiboded the market sliicfe^the early 1960js have been based on the premise 
pHa% children learn^aste'r and mor^ ^effectively If they are given tmmedfate 
feedback J n .titel^^i^ponses (Bilodeau ands^Ilodeau, 1961; Ammons, 1556). 
rinxjaddl.tlop, some^of these researchers and publlshers/have developed these 
mateVlaJs so that chl Idren^can progress through them without making any 
errors. Unlike the old mlaxlm "you. learn fr6m ypur mistakes,.'*^ theses persons 
Hold that errorless^ l^rnrng^ftrbduces a more stable response .more effi- 
ciently, and they rely'^heavl ly oh^ptbmpts and cues to allow the child to 
-progress' without error. ' ' . ^ 

j Prevleilyln'^ as an IrtstVuctional tactic may.also be a kind of prompting 
'device. Travers (196?) stated that a ^'warm-up" period may help stud^rfts' 
ftjnctlon at maximum efficiency when th^ task Is repeated. This "warm-up*' 
period' or previewing. may serve as a prompt for' the desired response.^/ 

Data Vvfere gathejred In several studies fo determine some effects" of * 
feedback on the performance of children. " ^ . 
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.Adverse pffects pf Self-Correction- in a ' 
Sutiject's Mathematics Rerformance , 

Kathleen Ljberty ^ 



This study Investigated pupil correction of mathematics material ' Y 
to determine If. this procedure facilitated progjj^ss In comparison with I 
the usual routine of teacher correction of material. 

The subject, was 9 thirteen year old boy enrolled In a secondary 
classroom. The Materials used Included Books 16 and 17 of the mathe- 
matl^ program frix^ Sul 1 Ivan Associates, at the Behavioral Research 
^Laboratories (1970). The, problems , were genera 1 ly three and four term 
double, dig It addition problem? with carrying. / 

Ourlng^ha'sek 1 and 3 the teacher corrected the pupil's work at' 
the §nd of a five minute work period. During Phases 2 and the 
pupil corrected hIsWi work. . ; / 

' For this. subject, V the data Indicated that lines of progress were 
superior In the **teacher. correction*^ phases.. Self correction did not ' 
provide- the benefits far this child asserted by learning theorists. 



The Effect^ of Informational Versus Correctional ^ n 
Feedback on a Subjects* Phonics Performance ' ^ - 

. Pat. Leu thy 

' ' -^^ . . ' . 

' , In this, study; the effects of two klfids of feedback were compared.^ 
Informational feedback Involved praising the chl Id , for correct re- 
sponses and telling the child when an error was made. Correctional 
feedback involved giving the child the correct answer whenever he made 
an error .as well as pr-alslng each correct response. Both medians and 
performance trends Indicate tha.t correctional feejlback was superior to 
Informational feeclback. 



Som^ benefits of informational, feedback were discussed In another 
paper by a Team II fftember.* 




\ 
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Easier Trails it ions to New Material: 
A Possible 'Effect^ of Non-Correctional Feedback 



Kathleen Liberty 



, This study, used '?orty-one subjects aged se>|$n through eighteen, 
years. Th^ "subjects were asj<ed to partficlpite ni a sorting ^asfe whifh 
ir>v61ved'^.tHe sortJri^of proa|essIve1y iopre shapes. During the flrst^ 
^^c"^ . ^ sorting task^the itf^ects^w^e not ^IVen feedback about their p^for- 
^. mar><;^l On a subsequent tds+^, I nforfnatlonaH feedback (knowled^^ of 
resilts) was given ^ach Subject. V- f ' ' ^ 'f^'? 

The g^oup /lata provide some l»^rmatlon about th4 effects of thr« 
partlcular .type-of Ujfoicfnat tonal ffedSack: A 



'J 



Telllny^the subject the performance results may ease 
the tranVtlon to more difficult material. 

' "* " 

Tfie effects of such I nformafctenal feedback will pro-'^^ 
ly be Immediate,- but not sustained* ^- * 

3) T)f}e effect will be demonstrated In rate of performance, 
- ^ r^her^^han fn^hange In perforniance over.tfme,^ ^ 

J^) JAThe effect On a group n^y b^^l^n In a mucfviwre^arJ- 
"^able performaTice range.j\' ^ < \ 



t^b^ ^^revlewlnb^ vLast y.ear^ studies on the use of previewing -as an: Instruct 
► t^lihal technJqM-$roved ^effective In* redutltjg the/amount of errors In, oral 
;ireadjng performance. Further invent Igat Into previewing was conducted 
this year.\ . ' f , ' . ' ^ ^ 



The EffTCts of Two Previewing Techniques 
on 0;al Read I ng* Rates » . 

Ingrld von Chrjj^ler^on / 



V ^ IfjfthJs study the effect iven^ss^f two previewing tactics were 

' evaluated:^!} oral prevlewti^ ^Itn feedback, and 2) previewing by 



listening to a tape selection.^ The subjects wer<^ two boys, ajged 
twel^ve and thlriteen Vears, Brirolled Irv a secondary class.' Uslbg an 
ABAC design, the author demonstrated that oral^ pi^evtewlng wlt>i.'feed- • 
back was t|ie^re effective previewing tactic In terms of both Increase 
f^^correc^jrjWe and decrease l/i error rate. ^ 



ERIC 




} 



J 



Cues/Dtemonstratlpn .. An Inv'estlgatf on Into those instructional pro- 
cedures which facilitate, skill acq§^sltl^ Is definitely necessary, in 
the pasty research has tended to focus W instructlon9l materials rather 
than Instructional procedures. However, Without systematic Instructional • 
procedures, even the most highly developed materials wIlTprovte useless. 
In addition we must concern ourselves with generalization, with some guaran- 
tee that the particular behavior learned will Be used In response other 
afppropr^ate stimuli. If a particular Instructlofta*! procedure wl 1 1 not. only » 
faci lltate.acquisltion^, but ^foster generalization, such a-procedure must 
certajinly be promoted. ^ Cujes and demonstration ^ay€i» been suggested as a 

tpsslble techniques, and the following research was Intended to explore 
his Issue. . v . ^ ' / * 

\ ^ / 

\ K ' ^ ' The Use of Demoi^^Vatlon to Facilitate^ \ ^ 

r * Skill Acquisition and General ization In Ar^t)iirtetic ' * ' ^ 

' Kathleen Liberty ; V * . ) 

This stud^i: investigated whetheV wim^klng a protflem (demonstration) • , 
for a sut^ect and thert leaving the completed problem^'on the .s!bbject's 
.desk (permanent model) facil itated j?k|.)l acqulsltl^ont Ski IT gfen^ral I- |^ 
zatlon to slightly changed stimuli was Also explored. This dcs»onstra-* ^: 
tion procedure was used^to teach two classes of math problems to a * * 
thirteen year old boy wfio^was performing at about first grade' level In 
arithmetic. "^"^ ^ * 

s I The use of demonstration and a pernwent model were very ef fec- 
tMvd In .changing the penfermance of this subj^^^ct. I^i addi tion, , further 
demonstration and model I ^ were.not necessary when th^ subject w^s 
presented with different problems of the same type. ' 7* 

^ * Fading CueS* Maintains Performance . 



of Oral Counting by Fives 

Kathleen Liberty ^ 

> ' > ' 

A seventeen year old sevelrely handicapped boy enrolled at ^ the 
Experimental E^ucatl^on Unit served as the subject In this study. The 
pupil had Just completed an InstHictJonal V^quente In'countliig b^^ones 
to Qjpe hundred. The/^/jbject's educatloncTl'^rogram est^ibl i.$|ied that . , 
the nekt skill t6^ be learned was counting by fives as 'a prerequisite'; 
skUb-for.a tlme'^el 1 ln_g program. A narrow sfrip of paper with, the 
numerals 5> 10, 15,. ...55> printed^ about one Incft apart, was placed on 
the subject's desk. The subjeot and the ^teacher. counted orally 
together for three complete, cofrrect sequences thrt>ugh the numeral? 
edcf{ day. Following this drill period, the subject wa^ asked to count 

' . 

^ \ 
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alone for thirty seconds while the teacher recorded theAnumber of 
numerals correctly or incorrectly counted. 4^hen the subject reached a 
criterion of thirty-three correct in the thirty second period^ with no 
error i, the next phas^ was ini^tlated. During .the second phSse, the 
practice period was' identical to that of the fi.rst. However, the 
numeral 5 was covered during 'the timing. When criterlpn was' reached; 
^he third phase began, with th^ numerals 5 and 10 covered during the 
'timing. During each subsequent pHase^ one mbrg numeral was covered 
dur'ng^ the^ evaluation period while' the drill periqd remained the same. 
During each phaSe^ the subject's response remained at about thirty- 
th/ee correct per thirty second period, while errors ranged from two 
to zercj^ However, when the numerals 5-^0 were covered, "fche subXect . 
was placed in a group home. Phases after this period- show a variable . 
error T^rformanqe. \ Due to the termination of'the School year, only .\ 
one performance day of no cues is recorded. On. the final day,, without 
cues, the subject performed thirty- th'r-ee correct with one error. 
Althoughfthe cues were^faded relatively slowly, the subject washable 
to main taij>. performance throughout the study. . Future follbw-up data 
will show \he maintenance of this skill. ,T-his is ^xtr'emely important 
for subje'cts who have a history of variable^performance (as does this 
subject) or who need to have relatively small steps in order to pro- 
gress^at acceptable levels. 



Jhe Effect of Cues * - 

{ on identifying Cursive Letters 
' • - ' ; ^ ' ' 

*^ ' IJatbleen Liberty ^ ^ ' 

The subject was a thirteen year pld boy who previdusly demon- 
^ St rated prof iclency>^in saying th^ alphab^ from memory and f rom • 
printed cues,, 'At the tim€i of this study,' the subject was beginning 
work on^curslve handwriting. Although the sheet given the subject was 
in alphabetical -order, the pupil .could not correctly name the single 
lower case^ cursive letters. A: one minute performance sample showed 
ethat during the seve>iiday basel ine^perlod,- the mpdian correc;,t per-- ^ 
^ focmance was twenty-six per minute, with errors "^t about twelve per 
minute. However, both 9orrecjt and error j^eiy^ormance were increasing.' 
At this pointy lov/er <£^se manuscript letters'were placed above the 
correspondimj* cursive letter, on the,^subj^ect's "probe** sheet. During 
the five day$^of this condition^ tha subjedt's median corrett per- 
formance rose to ^aventy-four per'^inuteJwhl le errors fell to zero. 
«- /Th^ printed cues w8re removed during the final phase. The subject •s 
, correct performance^was about equal* to the obtained cued median. 
^ However, "withoQt the^ Interventibh,' the^subject's performance w'oulJ 
, r^. have been* about that level anyway. Errors, however^ rose to a median 
> -'of ten per minute. Because .the final phase was ^terminated early. It 
i s Umpossl^ble to'tell If errors were increasing or decreasing. It is 
;>^fentativ^4y suggested that thie subject did not read the cursive 
letters dujring the period whert {Printed cues were available, so that 

i * 4 ^ , 
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the cues did not affect the performance of this skill. Since the 
subject knew the alphabet, the results are curlous.*"^Perhap^ the cues,, 
should have beeh written over rather than above the cuj^sSve letters. 
Perhaps future studies can look at the placement* of ,cuej| for effective 
behavior change. 



^ * . The Use of Cue? to Teach Mame 

and Addfress to a Secondary Aged Pu|>1 1 ' . 

tngrid von Christlerson 

^ The use of a teacher-made^ue sheet \o teadi name and address to 

. a>upll was InVesrtriigated using an ABAC design. During the A phase the 'f 
pupil was merely asfeed^to write his name and , address. Durtng.^hp B 
phase, the pupil was presented with ^ 'sj]ieet ofNpaper on which the 
puplTs name and addreSs were printed before he^'was a§ked to write his ? 
" name. During. the C phase, maintenance' of the skill was tested by 
having -the4)upll write his name ahd address" for the receptionist. 

The teacher-made cue sheet was^. an effective Interveatlon. Th^ 
effects were noted'oh correct and* error rate, but /most *4r«Hnatltol ly, on 
perc^nf correct data. , Correct rate was only slIgTitTy iliflqencM while 
' error Vate and percent correct wiere significantly Influenced. At the 
onset of the project the pupil was able x>nly to write his first name; ^ 
by the end of the project he had r^atned the Information taught ill qi* * 
^ ' with the aid of a cue with 100 percent accuracy.^ ' • 

The effect of cues on mathematlj^ performance has also been assessed. 
Drill with a model present* Is a tea.cr?tng tactic that" has received increasing I 
consideration by appl ied behavior analysts (Haring*, f97^; Eaton S Swenipn, - - J 
1973r Smith, 1973). An example of the use of a modej Is placing problems ' ^ 
with the correct answers at the top of an arithmetic computatloh page.- In 
these^ papers such pages are called cued mat^5 pages. Pages wrthout answers 
present are referred to as non-cued pages. A rational^, for the use 6T cued' ^ 
pages .(mode!) Is that children can perform arltKmetU p/oblems.easl ly^wl th - 
answers^present, and learning can occur with few errjprs: \ ^ % 

\\ ' ^ X ^ , ' i ' 

Cues are incorporated as teaching techniques In bther subjects. For 
ex^ample, when children learn to write, sample models of letters arc displayed 
on worksheets to show the child what the finished product should hook like., 
Some educators claim that cues can be a more successful instruc^^dcl ' ^. 
technique than teaching a child to rely on count^lng on flngers^or drawing 
lines to help compute answers. Count; ng^f Ingers or lines can be a rela- ^ 
tlvely slow process and will hinder the fluency of computation, as thfe child 
progresses .to more lnvol9edt»mathematI cs. During, thie last two yeafrs, thir- 
teen separate studies were conducted which explored different uses *of'%Ues^ ^ 
for teaching math facts.* 6ne study Investigated gerfprmance leve^ls In^ 
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mathematics probe sheets after cues were withdrawn. Five exploreq cues as 
a teaching mode by comparing performance of cu^ fact sheets with non-cued 
fact sheets and seven compared cfles and flashcards as teaching strategies.. 



Arithmetic Qomputatlon Drill ^ 
/ ' V/lth and Without a Model Present' 

Dale Gentry and Georgia Adams ' * 

rt 

flodelSy or cues, have* of ten* been used as art Instructional pra- 
cedure. An Important Issue, If one uses this tactic, Is what happens 
to a child's performance when cues are removed and the chtld^must 
perform the same^roblems without the use of a supporting device. 
Only If a child maintains or readily regains hfs previous performance 
level In th^' absence oiF cues^can^we assi^ne that he hasi *'learneil'*^^the 
problems and Is npt simply engaged In rote copying. The present study 
considers pupl 1 's performance characteristics over severat^days on ^ 
. cued math sheets, then oveV several days lon the same problems, but 

without the cues* " . • . 

ft. , ^ 

In general, the. data Indicate that the use of cued arithmetic 
pages can be effective Tn teaching arithmetic computation. Children 
performed with few errors durlng^cued phases, while Increasing their 
correct rates. In addition, when the transltl9n was made to compar- 
.able non-cued sheets, error rates remained low; pupils* accuracy 
remained high when cues were ^omitted. AddI«tlonal ly , correct rates 
decreased only moderately when moved from cued to non-cued p.ageS. , In 
most cases, the rates accelerated to the same level reached in \:he 
previous cued phases. , . 

Cued .sheets resulted In acquisition of math facts wftb few 
errors. Removal of cued sheets resulted, in no Joss of accuracy and' 
only a minimal loss In correct rates, ^whlch was readily regained. ^ 



. * * ^ ' Cues as a Method ' ' 

for Teaching Mathematics 

< ' ' . • 

Marie Eaton, Marsha Bayly-Schcene, >1ary Jo Hedges, ^. 
Valerie Cynch, and^Stephsnle Taga 

Five studies were conducted, which Inveslgcited Cues as a tactic to 
teach simple math facts. ^ The subjects \range^ In agevfrom eight to . 
fifteen years. Their prlmarry referral reasons also varied and they; 
bore such dlsparat^^ labels as autistic, severely men^t^tly retarded, 
^n^tionally disturbed, schizophrenic, and learning disabled. All the 
studies followed^a similar design^* fiat*^ facts were divided Into ^ 



separate. groups*. After baseline data were taken on -^11 groups, cues 
In the form of sample problems with the ^answers suppUeo^ w^re placed 
at the .top of the child's worksheet iPor one group only, while data 
continued to be collected oh all three. 

The following statements 'summaf^lze the results of these studies. 

1^ \^en'the problems'on the worksheet were presented to 

'the pupfl^ who were^ln an acquis it Ion' phase (correct . 

^ . rate low, error rate, high), cues were ap effective pro- 
cedure. 

2) \/hen the problems were presented to pupils who were in 
a fluency stage (correct rate .low, error rate low), <ues 
did not seem to make an appreciable difference in rate 
of improvement. 

3) Children who were more severely handicapped often had 
trouble learning to use the cues. 

k) Some pupils were able to generalize from cued to. non- 
cued sheets, while others showed Improvement only on 
I the cued sheets until cues we're introduced to non-cued 
sheets. . ■ > ' 



Cues versus Flashcard Drill 
to Teach Simple Math Facts 

Marie Eaton, tngrid von Christlerson, LyTine Ancjerson, 
'Jacque Ooane^ Connie Oeyaney, and Kathl'Terry 



Data were collected In seven different projects Jn order to^ 
comparte the relative effectiveness of cues and flashcard drll 1 on^ 
acquisiti.on and maintenance' pf math 'facts. The eight subjects 
varied'^ip age from eight to sixteen years. All wer^ performing far 
below grade, level I n mathematTcs. Identical multifile '*basei ihe 
designs were used for al) the studies. The math facts wer^ divided- 
Into two sets-for each pr<K:ess: easy facts (one digit answer) and 
harder l^apts (two-digit answer). Each problem In each ^et was' then 
randomly assigned to a worksheet (four in. each set) . No problem 
Appeared on more. than one worksheet and five v^flations of each 
worksheet were constructed. Ba'sellne data were then taken on all 
eight worksheets In whatever. process (addition, subtraction, multl- 
pUcatton or division) the teachfer selected. After the baseline 
phase, cues were introduced on one worksheet In the easy set and 
flashcards were Introduced on one worksheet In the harder set^ . 
Data continued to be collected on all worksheets. When the pupil 
attained desired rate on the cued«>or flashcard worksheet, the 



^. Interventions were alterhated so that f Ifiishcards- now were Intro- ' 
/ ' ^duced on the second easy worksheet and cues 6n the second harde^ 
^ I fact worksheet. ,The Interventions continued tjo alternate until 
performance o'rt all sheet? was at deslfed rate. 

^ ' ^-"The results of thfese studies can be summarized In the foj- 
-lowlng statements; ' . ' ^ * 

* * ^ ' ' ' . • ^ 

In ajl studies^ learning, was ev^yent with both cues ^ 

* and f lashcards, but cues were superior In terms of: 

a*. lines of progress, and . - ^ 

^b. the number of days required to meet the desired 

f ' -rate.- * - ; ' . 

" i . 

2)^ The Introduction of cue§ resulted In an Immediate 

provemept of correct and error rates with erf^or rates 
reachl4<g zero within the first few days. 

^ 3)' Generalization fladlngsnvere mixed. Most studies^ 

reported no general Izatldn with either Intervention. 

• One study, however, did report some generalization of > , 
Improvement to other worksheets when cues were Intro- 
duced. . 

\h) Maintenance after the Irrterventlon was discontinued 
was better for the cued pages. 

^ .These results seem to Indicate that when cues and flashcard 
drill are compared as teaching tactlqs, cues resulted in superior 
performance. Since cues'^are far l^ss expensive then* ftashcard 
drill in terms, of teacfter time, the^e results have special slgnl,- 
'flcance j|g^r teachers of children who present learrting problems. 
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RESEARCH AND APPLICATION OF A PROTOTYPIC. MODEL 
FOR INSTRUCTIONAL MATERIAL DEVELOPMENT 

Frequently, exceptional children have difficulty acquiring new skills. 
Thus, the learning process of ten proves' to be frustrating for many of these 

children, as well as for thetr teachers. Regardless of the difficulty,, 
however, It Is Important that children master a variety of speplflc skills 
so that as adults they' might lead Independent lives. It Is apparent to 
educators that there Is a relationship between the number of basic life 
skills which an Individual- possesses and his ability to function In society 
If, for example, one Is to successfully hold a job, there are many differ- 
ent skills he must possess. These Include the ability, to arrive at the Job 
site on time, perform the Job required, prepare, or purchase liinch, co- 
operate with peers, and return home. There are many ski lis necessary to 
complete this chain. Often,' success In a job situation depends on the 
ability to drive a car or read bus schedules, te1,l time, iijindie- money 
(deposit pay checks, budget expenditures and purchase ftems) , and recognize 
survival words such as men, women and danger. 

Typically, teachers of normal or gifted youngsters do not have to 
teach their students how to put on their coats^or tie th6lr shoes. These 
children come to school already possessing sucfy basic abilities^ SImllaV- 
ly* normal chl Idren. of ten learn to tell tlmcand make chanlfl^ without direct 
instruction. Those youngsters who do not learn by observing the actions of 
others, however, need to be systematically taught many of these skills, f 
Since there are numerous life skills which a student must master. It Is 
vital that Instruction time be effective. The need for an efficient system 
of presenting that Instruction Is apparent. Research has been conducted 
which Investigated a number of antecedint and sut:tsequent events (Smith, 
1973). The effects of Instructions (Lovitt S Curtlss, 1968; Lovltt & ^ 
Smith, 1972)^, feedback (Hlllman, 1970; Klrby & Shields, 1972), and rein- - 
forcement contlngencfes (Chadwlck & Day, 1971; Smith, Lovltt & Kidder, 
1972) have been the topic of much research and have Influenced various 
types of behaviors. If, hbwever, the actual material presented to the ' 
learner Is Inconsistent or poorly sequenced, learning will be Impeded. 
Unfortunately, af the present time effective curriculum materials for most 
of the basic educational and life skills needed by special education 
students are not commercially available. Classroom teache^rs are therefore 
left with the responsibility of selecting, sequencing and planning lessons 
to teach self-help and life Skills. 

( The primary focus of Team MPs research Is the creation, refinement 
and verification of a model for curriculum development. This prototypic 
model for the development of instructional programs and materials provides 
the educator with structure to guide him through the requisite steps fol- 
lowed Irfprdgr^ development. The materials resulting from this process 
are highly structured and pertain to specific skills. The prototypic model 
Is Intended to serve as a guide for the development of Instructional 
sequences which are neaf\); error free and which teach new skills In a 
minimum amount' of time. 



The Prototypic Model \ 

K ' .. V 

Th|.s prototypic model for instructional material^ development was 
Initially conceived under the auspices of the Program Project Gr^nt/ 
During the first two granting years. It was partially tested and^-refined. 
Continued research efforts wiUl be conducted during the final year the 
.grant, to test the efficacy' of the final steps of t;hls model. 

' V if \ 

Considerable refinement of- the model has occurred over -the past two 
years. Details are now available J n both a graphic (lattice) and descrlptl 
format • , » ^ . • •% ti>»? 

^ . \ 

Jo clarify the proces^^s used In this model, one InstructlonaV program 
developed during the first two'years^f the pVoject was silected-a^s^ 
Sample. The program alelected was-* Let's tell Tlure; when exampl^ are used. 
In the description *pf the model, this program is used. (See Figure 1) 

Prerequisite knowledge * * ^ , ' 

- N^w skills are develbpecf by building on those already .mastered; 
knaWvedge is exparlrded and refined. To successfully master a ri©v5kijl, the 
prerequisite skill should be mastered* The educational programmer mi|st 
- fome, to his task with some entr7 skills. ' First, he must.be thorotighly* 
famll\l^ar with the skill ti/lie programmed. Mf he wishes to create an « . 
Instructional p>rogram to teach youngsters' how to tell time, the Instruc- 
tional programmer must be proficient In the skill of time. telling. ' 

• Besides ^knowing how to^perform the ski 1 1 , the fjrogrartm^r should be. 
competent In basic programming techniques, Sj^cn aar" cucTln^, fading/ anci 
chaining (see .Sklijner, 1963)\ He must be abl,e to create InstrudtJondl 
frames which wljl break the task Into steps small enough- to be mastered, 
and still retain the* Interest* of the learner. * * . 

In addition to these two general sklTls, the instructional programmer 
must be aware of general hqman learning characteristics. For example, he 
must' be able to build into hrls <sequences enough repetition to allow for 
over learning. He should know how to Include demonstration sessions to 
provide model ing, and review sessions to Insure tjiat mastered skills are 
maintained^at a proficient level of performance. 

needed refinement of this component of the prototypic mode:!. 



Primary decisions 

If the educational programmer feels certain that he possesses the 
necessary entry behaviors to -approach the task of creating educational 
sequences, he Is ready to begin the process of developing a skill- j ^ 
specific Instructional sequence. There are important decisions which ^ 
must be made tnitiaTy. First, the specif Ic/klll to be programmed 'must 
be clearly and precisely identified. In our. example, time telling Is 
that specific skill and the terminal objective of the proposed sequence. 
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In th(;s^spq6ence only ti'ftre ^^l_yUhg Is taught;. the -sequence does not Include 

^Instru^.lon on number reco^lfiort, l}he use of a punch clock, or how to set 

af? alarrti clock. In thli example, only the skill of telling time or reading 
a clock .Is programmed. ' 

'•^^ ■ . 1 . .• ':'■>••'',.<•. 

f r^he'^dh A decision whl«^;nfust be^^de 3«: this point, regar.ds the* 
, intended, aiA^le^e oP target pppulatlon for whom the program- Is to be written 
. The injtructlTSnaT pi»o'grammer\v/l ll have to^reeognlze specific deficits which 
pccuf^n^hls .tarfgeK-pppu'^atlon.. If, f6r example, the sequence will be used 
prliparlly -by vl.&tfdriy handicapped students, *prlnt size on;worksheets will 
have to.li^^ltered or . worfeheet's will have to be omitted from the :p>ogram. 
Bra-ilje Watches mjght be used asl ljesson aids. ' ' - ' ' 

1 • * '* • 



. Lattice developed ^ 



> Once the targef^SkUl and-popblatilon have been precisely defined, a 
ytask ,ana lysis process Is Initiated. Team. Ill has modified the lattice 
system developed 'by Woolman (I.962) to Implement- tffTs, step of the protbtyplc 
model.- As th I s» component of the model seeims partiWlarly applicable to the 
dally need^? of the classroom teacher. It will be discussed In qreater 
detail here. ^ ' - " ■ %> ■' 



The lattice calls for a graphic display of the analysis of specific 
tasks. Goals >and objectives are put f ntoiy Bl'erarchy so educational acti- 
vities can b,e planned tb help studdntS' maste^ various skrili. In a systema'tic 



fashion. /. * / 



It Is Important for 'teachers of handicapped youngsters to carefully 
specify' what academic and spclaV behaviors their students need to acquire. 
For successful learning, goals must be precisely stated. The Identlfica- , 
tlon of a task to be mastered Is only the first ste^' towards the, develop- • 
ment of an:ed.ucatlondl sequence. Often, the subgoals of tasks need to be 
specified. These subgoajs can- also be broken down Into smaller Objectives, 
Careful sequen^g>f these obje.ctlv^s^ cubgoais and major goals leads Co 
the achievement of educational activities to. l^ad.tfie learner to mastery of 
each obj^.ctlve along the way to mastery of the tasted * , 

The lattice system Is one way \o organize educational activities and ' 
to sequence ^skl lis. Once a lattice Is Constructed, the sequence of events M 
which eventually lead to the complet'^on df^a task' Is clearly delineated. 
The lattice forces thfe teacher to specify goals and Objectives. ^ Integral 
parts of a task are specified and put Ifito a hierarchy; thereby, the 
sequence of a task becomes Identified. 

The lattice t% not an Instructional sequence, ncrr does It outline the 
exact activities Included In theNducationaT sequence. It Ts a display of 
the component parts of skills. The sequence of behaviors which lead to the 
ccfinpletlon of specific tasks- Is arranged and displayed In lattl^ format. 
When ^yron Woolman originated the lattice system, he did so to gfvte structure 
to the*orderlng of educatl9nal activities; He felt that by lattlcBng a 
task before Instruction begins, the teacher could see the relationship and 
Integration of concepts to be taught?S Wgplman (1962)* expressed thfe Intent 
of his lattice system: - ^ V 



any body of material to be learned can be organfzed Into ^ 

a Sequence which permits the sv^tematlc growth of a pool ^ 

of relevant responses t(x,the ^ttmulus being lear'^ed. as * 

learning progresses, the lesy^ner Is alternately required 

to add new Infonoatlon and Integrate ft into the ever growing 

pool. This continues until the learning objective Is 

achieved (p. 181). . • 

- A ' ' • 

others, since Woolman Initially proposed the lattice system, have also 
adopted his procedures. Budde^and flenolascino (1971) showed how the lattice 
system, can be applied to vocational habi Ktatlon. ^Jrlcker (.1972) used a / 
lattice format to display his sequence for language acquisition. Smith and 
Smith (1973) employed the lattice system before, they developed structured 
Instructional, programs for s^f-help aod life skills. 

^ ' ^ ^ ^ ' . / 

Lattices can be very sophlstlcateU or very simplistic. They can be 
constructed In such a way as to show the relationship of one ski IV to S 
another. They can become three-dimensional to show .the difficulty as well 
as the sequence, of component taskb.. Such complex systems^ however, are 
often confuslfig. For the purposes of organizing educational activities or 
analyzing Instruction^ skills, complexity Js usually not necessary. / 

For most teachers' purposes, lattices should simply state the analysis * 
of a ta.sk. Simplified lattices allow for ease I(j(^comm«nicatlon among' 
teachers who use this system for task analysis. One other advantage of 
using a simplified lattice system Is for speed of construction. To meet 
the many educational needs of their students, teachers oi&ed to be able to 
analyze specific skills as quickly as possible. The following section 
describes the procedure which teachers can use to construct. lattices to 
display their analysis of specific skills. 

Lattice constructFoi^ . Since a lattice Is a graphic display of an ^ - 
analyzed skill, there are specific procedures which must be followed In Tfs 
cqnstructlon. Since there Is a sequfenqe of event^whlch must be followed 
to construct a lattice, we useNp lattice to dlspla^thts sequence. (This ^ 
Procedural Laittlce for Lattice Development is prese/ited in Figure 2.) In 
addition to the graphic display, narration Is included to explain what the * 
boxes mean and why they are placed on. the lattice In their respective i 
positions. ^ 

Prerequfslte knowledge^ Just as children need to possess specific 
skills before they can perform complex tasks correctly, so too must adults 
possess^ certain skil ls before they can break down a task and display that 
analysis Jn lattice fbrmat. Before a teacher breaks a skill Into component 
parts and attempts to construct a lattice, he should, know what a modJfied 
lattice Is and how It Is used. The sections Included Jn this part of the 
lattice, summarize the knowledge a teacher should posses before attempting 
to »Mattice" a skill. 
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• ' la. Lattice System , Some rules and conventfons are followed when 
constructing a lattice. First, the purpose of conSLtructl ng a lattice is 
to obtaln\a sequenced Ust df the major component parts (enroute objectives 
and'subgoalsnof a ski 11-^ be taught. 'After the teacher analyzes the 
skill and puts the a.nalysis In lattice format, he will refer to It as he 
, designs the instructional sequences to help his'students attain mastery of 
the desired behavlo^;. The format^ used should be con^ I stent^ so Interpreta- 
^ tlon of/the analysis Is Identical to the sequence orlgtoally Intended," 

the second reason for following a prescribed format. for lattice cdn- 
^structlon is cbShmun lotion. If other teachers analyze/skl 1 Is In the same 
manner, lattices can!^e shared with* col feagues.^ Skll 1* analysis and se- ' 
^uenclng need not be dpne over and over again by teachers in contact with 
one another. Specific details about latticing rules are found undfer heading 
number h\ Graphic Representation. 

* lb. Subject Hatter . Prerequisite knowledge of subject matter Is mor.e 
lmport|0*^than knowing the rules and conventions for lattice construction.. 
The teacher should have a thorough knowledge of the subject matter' to be 
analyzed.' It l;^ Imposslble^to break down an academic task or ski 1.1 If one 
cannot successfully complete the task himself. For example, a teacher who 
jieeds to teach his students how to tell time cannot divide that sklfl Into 
component parts without knowing how to tell tlni^. accurately. ^ ^ . \ 

1 1. Task analysls.j Aftfer the teafehe^efels-~t4iat he Is faiftlllar with 
the procedures used to construct a lattice and Is competent at "peitformlng 
r\^e task to be analyzed. It Is^me for the analysts of the skill ^to begin. 

^ 2a. Identify the skill . The first decision for, the teache.r to make 
regards the task to be analyzed* He must determine precisely WtiSr task he 
wants to submit to analysis. Skill tdentlf Jcattbn must be specific. If a 
child needs to^ learn how to ♦•le his shoes, then shoe tyfng Is the task ta . 
analyzed. The tearnef mlight also be deficient In putting 'Shoes on his 
feet, but that Is a different task and should not be. Included In the shoe / 
tying lattice. In the 4>resent example, time telling Is the 'task. which was 
submitted to the task arvalysis, rather than a time concept such as prompt- 
ness' or tardjne^s. 

^ ' ^ . ' * 

2 b. Determine Entry Behaviors . After the task to be analy^sed Is^ 
Identified, the teacher .should decide what skills he will fxpect of studfents 
beginning the sequence. For example. In constructing the lattice for Team 
llP*s tijme telling program, It Was realized' that number recognition con- . 
stUuted an essential prd^equjsflte >km. The authors decided, ^owever, 
not to teach number recognition when they teich time telf^ig; therefore, 
students are e^xpected t<^^demonstrate a prof lei ency' In that skill before 
f entry to the program. t:n Instructional program^.wbtch use a considerable 
amount pf color\cyelng, color recognition shoulp be an entry behavior 

Our experience Indicates that ifnbre efficient Instruction occurs If 
prerequisite ^skl Us are masteVed before the student inters a specific, 
sequence such as time tell Ing.' In'many cases, entry beh^vlors^are deter- * 
mined In an arbitrary/fashion. Different teachers expect different entry 
levels from their students, f^eveftheless, some entry levels should be - 
O specified. , ^ ^ ^ -or-zJClKl ^ ' * 
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2c, Analyze Ski 1 1 , Although not a sophisticated or scientific method, 
one way, to analyze a skljl Is to use a rep&tltive process. As the^ teacher, 
performs the task and observes others execute Jthe skill over and over, the 
sequence of behayjors becomes app^arent. The major component parts of the ' 
sklir'can be Identified;, and' the/often Inherent sequfence'of events becomes 
obvious. As the teacher repeats the task, he should carefully scrutinize 
his actions. Each step should be identified. » * 

As the skill Is analyzed, each part of the skill written on an ^ 
Inde^ card. . In this way,. the sequence of these component parts can be 
easily ordered and reordered.; ^ ' 

2d.- Sequence .. Once all the component parts of the skill have been 
Identified-, each part Is sequenced. Frequently, the sequence develops 
directly from the skill. In shoe tying, for example, the 'sequejnce of 
events followed to .tie shoes Is constant. The natural order followed to" 
complete the task- Is the seguence. 

When the sequence of behaviors Is Identified, a hierarchy of skills Is 
concurrently determined. Some parts of- the skill are major component 
parts; others are, subordinate steps which lead'^to the completion* of the 
major st^ps in 'the process. In shoe tying (the lattl^ce for Team. Ill's Shoe 
Tie Program js displayed In Figureu-13)t completion of the half-knot and 
tying the bow are two major component parts. These, then, are'^the subgoals 
• of the final .or terminal goal of thg student mastering- the skill of shpe 
tying. ^ ^ \ ' ^ . ' 

For the time telling lattice,^ six such major subgoals were Identified 
ranging from "hand discrimination" to '*time,.af ter hour discrimination." 
The enroutc Objectives' which lead tO-/t he .-completion of eacl;i of these sub- 
goals are placed under the subgoals to represent the^hlerc^rchy of ihe steps 
in the task. - * — ~ . ^ ' 

' All of these steps (Identification of the ^kllU^the determination of 
y'the entry behaviors, the analysis of the skill -and the eventual' sequencing 
of the steps "used to complete the task) comprise'^ the major elements of the* 
task analysis process. ' v ^ . 

3> Cell components . Lattices are comprised of a series of Interlocking . 
boxes or celK. Each of these cells must ^be placed In positions that 
represent the sequence and the analysis which was determined Irt the preceding 
step of this prbcess. The terminal, tphavlor or goal, the subgoals and the ' 
enroute object I ves^how iare stated concisely and marked, for, the graphic 
representation. The next step In lattice development can be completed. ^/^^ 

*. • 

/ 0a (1). Enroute Objectives . Enroute objectives are those behaviors 
. whick lead to the completion of the subgoals. For the "Minute after visual 
'\and auditory stimulus dlscrlminat;lon" ^ubgoal of the time telling sequence, 
stepi such* as "Counting cldckwlse 5's" are the enroute objectives. These ^' 
«re' placed underneath the subgoals. I 

3a (2)> Ridgeline . The lattice ridgeline Is ccnnprlsfed of the subgoals 
and terminal goal of task (Figure 3) . ^ When the, lattice Is formed, these . 
are conpected Ip a step ladder fo^-mat wlilch leads up towards the terminal 

behavior. ^ - ' 

/ ' . * • ^ 



3b.> Terminal Goal . There Is one terminal behavior or goal for each , 
lattice* Depending on the complexity of the lattice, the terminal goal 
. .could be as concrete as '*lshoes tied'* or as abstract a$**'tlme' cpntepts;'* 

Regardless of the nature of the skill whJch,iS analyzed, there Is tjniy one, . 
.concisely stated, terml.nal goal for each lattice, in this example, /'the ^ 
'terminal goal is **TeH Ing, Time.** All the previously I dentjfied steps lead - 
directly, to the completion oiF the termlnal ^behavior. * ^- - ^ . ' 

%. Graphic representation . For lattices to cons I intently Interpreted 
by 'many people and to be meaningful to the person whovconstructed, the 
Uttice, certain rules or coWntlbns should be followed. Since the lattice 
is a blueprint or master plan which depicts the steps^ and the sequence 
which ie2|d the learner to mastery of a specific task*;' It is .Important- for 
the graphic dispjay of , the analysis to be easy to Intj^rpret. } 

^* Ay Rules . For^a lattice to be fn,terf»reted consistently, th^re are 
some rules about placement of the cells and lines which. connect thejtells. 
^Rules about lines connecting cells and descriptions of cell placanenft 
• follow. ' 0- . ^ " 

A step'' ladder format. Is used for the arrangement of ^he sufegoal 
sequence. These boxes display th I S; sequence f rem left* tp rlgh^. The 
ridgelin^'i.s connected by Unes'which form right angles {^ee Figure 3). 

Whenever possible, enroyte objectives are 'connected to each subgoal * 
cell w4th. straight, lines/ If necessary to show three, or mbre enroute \: 
objectives not primarily related to each^other, these, may be placed under - 
the subgofl cell with.both straight and bent lines (Figure"^): ' 

If one enroute objective must be completed* before another task li • 
. Initiate^\ the celjs are put. together in a chain. When one task Is defi- 
% ^nltely prerequisite to the next, the first objective in the- chain Is put Irj 
'^/the-bottom cell. All of the ensuing enroute objectives Jead up to the 

'^^subgOcTl (Figure 5). . ' ) 

• < \ . • 

Major subgoals may be considered terminal goals of **mlnI-progcams** 
within one complete lattice'. ^ In some cases. It is desirable , to have ah 
' overall lattice showing how'ski 1 Is relate to each other for^cfurrtculum 

pl'anjil^g. Thisccan be accomplished by uslng'the lattice. system also. In 
^- 'the example shown below (FKgUre'6), two small 'lattices arc putv4ogiPther 
- 'under one terminal behavior. This format can easily be adapted for the 
.purpose of displayi.ig the progression of skills tausht in one academic year 
for parjidular skill areas such as computational arlthmetlc^or self-jielp. 

^a./Entry^ Behaviors . These are b^^vlors.or skills which the Jearner 
, * must possess before hevbegins the instructional sequence developed from the 
^^attlce. These do not appear as eel I - components, but are listed on the 
lattice page. A jconvenient place to list the entry' behav ions is in the 
" upper left hand corner. They are labeled as entry behavlors'and $tated in 

, > concise' terms a1id usually appear as ^ list. * / 

• * ' <i ' * 

' ^b.'^First Enroute Objective . This objective leads to .the completion 
of.t^e subgoals which, in turn, leads to the completion of the terminal 
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goal. If the sequence of these objectives Is a simple progression, the 
first enroute objective Is placed at the bottom of the chain. I,f several 
objectives or a set of objectives are included under one subgoal, the-goal 
which Is mastered first Is placed 'to the left of the other enroute objectives. 

■ • V _ ■ - 

kc (1). First Subgoal.. The first subgoal In the sequence, the first 
rldgellne cell, Is placed towards the bottom left hand corner of the page. 
The enroute objectives which pertain to the completion of that subgoal are 
positioned underneath this first rldgellne box.' , 

kc (2). Subgoal s . The remaining subgoal s are positioned in step 
ladder format (from left to right) ieading to the terminal behavior. These , 
corat>rlse the rldgellne. 

^d. Terminal Goal . The terminal goal always appears In the upper 
right hand corner. It Is stated concisely and' i s posi ttoned ^to clearly 
indjcate' that It Is the fend-goal of the sequence. ' 

5. Lattice Developed . This is the terminal goal of the task analysis 
process, described In this section. Before a lattice Is truly completed, 
however,' some final testing and evaluation must be conducted. 

5a . Test Component . The teacher should perform the latticed task once 
again" As he does so, he should folloW the lattice as It is now constructed. 

Each component of the task should^be scrutinized to be certain that the. 
words which appear In eac\\ cell adequately describe the behavior. In 
addition, the sequence should be rechecked to guarantee accuracy of the 
order of the behaviors. 

5b. Evaluate . The entire process needs to be evaluated. If the 
teacher finds that the-lattlce does not display, the sequence or the analysis 
properly, this should be noted.' If terms %re misleading, those terms must 
be Identified. ^ - . ' 

~^ 5c. Modify' . If errors In the lattice-have been Identified, they must 
be corrected. If 'entry behavlocs were omi t|:ed, they must be included. f 
the order oi the subgoals was Incorrect, It should be adjusted. Once all 
of these final checks have been completed, the task has been analyr.ed and . 
displayed so that instructional activities can be organized. These actlr 
vltles should aim at bringing the learner to mastery of each enroute 
objective and its subgoals. Mastery of these component parts of the 
lattice should eventually lead the learner to mastery of the terminal 
behavior. The lattice for time tellltfg was <fonstructed In this manner and 
is Included as a sample lattice (Figure 7). 

The lattice approach could be helpful to teachers'^ as they plan their 
curriculum activities for a year, month, or week. The system allows teachers 
to specify which skills they want their students 'to master. In addition, 
It allo(j!(r them to display the analysis of these skills In a simple format 
so that enroute objectives can be easily Identified. 

The lattice system Is an adaptation of the original Woolman system; It 
was modified by Team III members to suit the academic Instructional situation. 
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^ . \ The adaptation attempts, fn simple terms and format, to provide a mode] of 

a complex task or concept. It does not Include every 'detail of the analyzed 
task, nor does It display the tactics which are employed to teach the task. 
^.However, the lattice sy/stem does provide the teacher with an outline from 
"which he care plan activities that will help his students ^cqbtre needed 
skills for which effective programs are .not currently avallal}le. Similarly, 
for the programmer who Implements the prototyplc model- In Its entirety, the 
^, lattice serves as a blueprint from which the Instructional program Is later 

'built. ' ' s 

Pretest Package , . • * 

' • ' 1 * • 

On',e the lattice has been constructed, It plays an lategjal parp In 
the next stage of the program's development^ — the development of a pretest. 
^ ^ Test Items are constructed to sample each behavlor-ldentlf led> In the 

lattice. The purpose'of the pretest Is threefold.. First, the'test Indicates 
whether the learner has already mastered the task and does not need to 
, .enter the ^Instruct lonal- sequence. Secondly, the pretest samples the entry 
behaviors to determine whethcjr the learner Is ready to enter ttie sequence 
, at -Lesson 1. The thl rd purpose relates to differential placement In the 
program. If, ^or exampfe, the learner has not mastered the. task, but can 
successfully complete some of the component parts of the skill, the learner's 
exact beginning level should be specified. In this way, once tho program 
Vs fully developed,' not all children will begin with the sam^- lessoh^ 
Students who Initially possess some of the behaviors required to perform a . 
task successfully, but who cannot accurately complete the termJnal behaivlor, 
can be placed- In the Sequence according to their Initial skill level. 

Test items are constructed for each component part of the skill; Items 
are l ncluded^ f rom ea^h ridgellne and many enroute boxes. Haterlals-needed 
for the pretest are developed and a data collection system is prepared* . 
For an accurate Indication of each learner's skill levels, prf-tests are^ 
Individually administered. Because the pretest is a critical part pf the 
entire program package, fleldtestlng Is required to determlrre whether' the 
pretest accurately Identifies varying skill levels. 

' ' Program 'Format 

The next decision relates to the program's format. One option might 
be a series of worksheets which do not 'require teacher assistance. In this . 
case, a teacherless program Would emerge. Another option mlghi consist of - 
structured lessons for teachers or paraprofesslonals . This procedure 
produces either small group or one-to-one programs. The time telling 
sequence was developed for use on a ona-to-one bcsis* Since this is an 
expensive educatlohal procedure, the Instructional sequence, was designed 
for admlnlscratlon by untrained an well as trained personnel. 

Initial- FI el dtest"^ Population 

In tills stage, the first group of learners to receive the Instruc- 
tional 'sequence Is selected. The pretest Instrument, already developed, is 
used for this purpose. Those having all of the entry behaviors, but riot 
possessing 3kll Is beyond those taught in the first lesson are selected. 
Learners possessing advanced skills could enter the sequence, but to verify 
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>each lesson, those having only the entry behaviors are used for this flrjSt 
fteldtest group. . ' 

Initial Fleldtest 

Phase K The Initial fleldtest stage consists of two phases. In the 
first phase, actual lesson writing Is done.,concurrently with fleldtest Jng 
by the program writer/ General criteria levels are established for all of 
the lessons. In the time telling program, the authors decided that no more 
than 10% error, would be accepted for each lesson. Therefore, any lesion 
not meeting the criterion of 90i correct responding was rewritten. A. 
general da.ta collection system was also devised.. Data were collected for 
each frame for each lesson. This allowed the programmers to determine when 
a sped ftc frame •produced most of the error. V/hen this happened,- that 
frame was corrected' and retested.. Rewriting continued until most error was 
eliminated. ^ • 

A format was also developed to facilitate the actual task or lesson 
writing. Since these Instructional programs are highly structured and are ' 
Intended foV use with a wide variety of pe^rsonne)) (e.g. parents, volunteers, 
and classroom aides), a 3 column format was developed for ease In adminis- 
tering the lessons. In our system, all of the teacher's directions are' 
found In one column. Those actlqns'used Ho model the, desired behaviors are 
catjefully described to the, teacher. Words said to the student are printed 
In capital letters.^ All of the student responses are found In the^second 
column* Uhenever the student Is required to answer a* question. Imitate a \ 
behavior,* or manipulate supplemental materials, the student's expected 
response Is Indicated In this column. The^thlrd column contains suggested 
remedllatlon activities. In some cases, all error cannot be eliminated by ^ 
rewriting the program. Whenever a problematic Instructional frame occurs, ^ 
an elaboration of the teacher's dl rectlons appears/ In this column. A 
sample lesson format Is Included (Figure 8) ^ > 

The first lesson of 'the program Is. written once , a- convenient lesson 
format has b^en designed. If teaching aids are used. Inexpensive ones aire 
developed. 'The tasks taught In this lesson aim at bringing the student to' 
mastery of the first enroute objectl\/e of the first component part specified 
in^the lattice. Each lesson should bring the learner one step closer to 
mastery of the terminal behavior. Even though more than one lesson Is, 
required to teach one enroute behavior, the aim Is to move the learner pro^ 
gresslvely closer to the target behavior. After the first lesson is 
written, It is tested on one or two subjects. If excessive error occurs, 
the lesson Is rewritten and retested. The second lesson Is then written 
and fleldtested. If more error occurred than was allowed for In, the original 
criteria, ' the lesson is rewritten and retested. These procedures are . 
repeated until alf of the lessons have been written and fieldtested on a 
small population of students. 

Phase 2 . The second phase of initial ^fieldtestlng is now begun. At 
this time the entire sequence has been developed, but the program has not 
been tested In Its enti rety because of fhe considerable rewriting inherent 
in the first phase of InitUl fleldtest! ng. Therefore the program is now 
submitted to a/iecond phase^of Initial f ieldtestlng. In this phase, the 
program Is administered by one or two of the program writer's colleagues. 
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. .Feedback from these admlnlstr<ators enables the programmer to clarify any 
teacher directlpfis which pVove,|o be ambiguous or Incomplete. Approximately- ,^ 
10 children are selected for, thW 'fleldtes ting* These chl Idren .pbssess 
only the entry behaviors specified In the pretes.t and lattice, .and\ar8 not 
differentially placed In the prpg^-am at advanced levels^ The ^nt I sequence 
Is then tested with these children to Insure that the majority Of ^rror was 
eliminated In the previous sta^e*./ If thes6 fleldtest data Indicate that 
the sequence does In fact bring children to mastery of the termlrral 'beK)^vlor 
with a minimum^ amount of error, the program'ls ready for , secondary fieldV 
testing'. If, however, substantial error occurs during this f leldtestlng,^ 
the progran^ needs to be rewrltt^^n and retested. 

Secondary Fleldtesting 

;^ Once the Instructional program Is written, fieldtested with a flmlted 

number of subjects, a nd.^ rewritten,^- the sequence Is ready for more extensive 
f leldtesting|, Jlultlple packages of the Instructional program are produced^'* 
The teachers^ ftianuals are edited, typed, duplicated (at least 50 copies), 
and bdund* If supplemental materials such as teaching aids anti , student^ 
workbooks are used In t;he program, they must also be produced In sufficient 
quantity for the secondary fleldtest population. Teaching aids should be - 
durable and reusable,- with the exception of student workbooks. 

Additional f leldtesti ng I s required for several reaspps. First, It Is" 
Important for more' chl Idren to be Intluded In the fleldtest population/ 
This number need not exceed 50 youngsters, but should be more than the 12 ^ 
to 15 stuBents who participated In^ the Initial fleldtesting stage! Add4-. 
tlonal students are needed to validate the Instructional sequence and 
determine whether error pile-up occurred ^because pf unclear M n'structlonal 
frames, \ ' ^ 

Another reason for the secondary fleldtesting relates to teacherr 
Induced error. In the Initial stage of fleldtesting, the Instructional 
programmer aVid those familiar with his (>rocedures tested the program. 
Because of thjb ^*in-house** nature of the Initial fieldte^tlSig, elements of 
the directions may have been omitted or written unclearly. Instructional , 
programmers frequently use jargon familiar pnly to themselves an<l' their t 
colleagues. This jargon could mislead or confuse the classroom teacher and 
could resMlt in new student error. ^ ' » ' ' 

Before an Instructional program Is ready ^'or dissemination, those 
parts of the lesson sequence which caused teacher-error should be isolated. 
This Is accomplished by analyzing feedback from teachers using the program. 
First, data gathered in the secondary fleldtest stage should be analyzed. 
If numerous errors occurred In sections which were error free* in the 
Initial f Leldtasting. ?t Is probable that teachers did not understand the 
directions as intended. In some cases error plje-up occurs for one teacher 
and not for another. This kl.nd of Inconsistency will appear in children'^ 
data, indicating ambigylty In teacher directions.^ 

Often, however, student data fall to indicate ambiguity which exists 
in . teacher directions. A teacher may not understand the directions In one 
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section^ but If he teaches It appropriately, the student data will rrot 
Indicate ^ need for rew^-ltlng. The^^econd klhd of feedback, dl. -t. com- 
munication with those using the program, will make this type of problem 
apparent to the Instructional programmer. Whenever ambiguity or error 
occurs, the Instructional programmer bas an obligation 'tb. rewrite those 
sections. ' \ . x 

Final Fleldtesting ' ^ 

During the last ^hase of Instructional material develqpment, enough 
program packages are produced to conduct finaj fleldtesting with another AO 
to 50 students. The pt'ocedures used In secondary fleldtesting are repeated 
In order to validate the entire program Including* all of , the revisions^ \ 
Each f le-ldtesting stage'has had a si Ightly jmore sophisticated purpose. The 
Initial stageHested the fljrst draft of the program with emphasis on 
student error. ' the secondary fleldtest stage specif leal ly.^inon I tored both , 
studen;t and teacher error,- After these steps have^been completed, the 
Instructional program Is ready for dlssemlnaM^* Final fleldtesting J 
Insures that revisions made after the secondary fleldtest stage^actually 
reduced student arid teacher error. ^ 

I'hstructlonal Program developed ' ^" * 

The specific sRtll taught by the I nstryctlonal sequen.ee has been - ^ 
carefully selected and analyzed In such a wl^ thdft* each step i^n acquiring . 
the^skll^ was^ precisely identified atid sepueilced/ .The lessons have been ^ 
written so masterly was obtained on ea%h of ^ese steps, and the emerging^, 
progr^ has been fleldtested at least three times. The re^ are various ways 
to accbmpllsh dissemination. Including ^federal l^ sponsored clearinghouses 
and. cbmmerclaf publlshersT. The Instrycttona'l 'programmer ne^ds to determine 
the most appropriate v^lcle to disscmiMiate tl\fe now fuMy developed Instruc- 
tional program. \ ^ 

• ^ ^ *%tatus In Septerfiber l:)/3 

During the f.lrst year'^c^f this project (1972:r 1973) the lattice system 
was r^flned'^and several Instructional programs were written and developed 
through the first stages, of Initial fleldtest] ng at the Experimental 
Education Unit (EEU).* .By ^September of this past year (1373), four progran>s 
had entered the final stages of InitL^l f leldtest^|ngj (1) Shoe'jY'ng; (2-) 
Measuring (Ruler), (3) Time Telling, (^.) jljlake Cha^jge: (a) Coin orscrtmina- 
tion, (b) BUI Discrimination, and (c)' Honey Values. In addition, one 
program (Alphabetizing/ h^d been written and was ready for Initial field- ' 
testing, • • • * | 

Considerations of itmlted time and resources necessitated a reprlorl- 
tfzatlon and and revision of the original 1973-197^* Scope of V/ork projected 
for team Ml. the final objectives selected for the academic year 1573- 
• 197^ were as follows: • 

» 1. Continue research on the methodology of creating 

Instructional programs (I.e., development of the proto- 
typic model) • 
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A> The latticing technique 

Be Dissemination of research on refinement of the proto- 
V typlc tnodel ^ , ^ \ 

M. Continue refinement t^prototVplcnwdelprop^dur^^ 
actual program deveiopmentl . * . ^. ^ ^ * 
. ' A. Reach the Secondary TIeld test S4E:age; 
'\ > 1. Shoe Tying V 
. * ^ * 2. fle^gsurlng (Ruler) l 
• ^ . 3., /flake .Change: : . \ " ' ' 

. a) jColn Discrimination ^ 
, ' ^ b)>tfin Dlscrtmlg^Uon . • \ 

c) Money/ Values . ' ^ . . ' ' ' 

\B<* Complete InltVal Flel^testlng and Mat;erlah Preparattor\: 
* _ Time' Telling ^ m , ' . ^ 

C. Reach "^the wr^ln^«tage,for New Programs:* 
• K C^e program tW tbe area of pirlfnary* level- life skills 

^. One extensij)^ of^n existing program ^ , 

' ' Present^ Status 

IHiVlng the past year, \f.leldtest data general ly stipported the. \ 
efficacy of the protbtyRlc model. (Specific data wllV be presented'^ln, ^ 
the >dlscuss|on of 'Pndtvl^ti^l programs.) however, as problems^^irose, some 
revisions were made In tHe^igdehj^ These revlyfons primarily reflected 
pragma tic, concerns pe4atlng to aclEual procedures employed (e.g.., 
pretest format, data collection, data dUpl|iy) . It Is felt th^t these 
revisions have made the model more efflclen't and more broadly appllcabile. 

Dissemination efforts this year have been largely restricted to the ^ 
lattice system of task analysis, as this is the most completely developed 
and validated aspect of the prototypic model to date. * However, dissemina- 
tion of the total model has been Initiated and these efforts will be» .con- 
tinued throughout the summer. . A detailed record of Team MMs research 
dissemination for 1973-197'* Is presented In Table 1. 

Of the three programs projected to reach the SecQndary Fleldtest stage 
this year, only one (Shoe Tie) has actually b^en placed In Secondary field.- 
test sites. Secondary fleldtesting of the Ruler Measurement Program v/as 
delayed until the public schools open In the fall to allow for^the develop- 
ment of a complementary program In Metric Measurement! The latter program- 
Js now In the final stages of Initial fleldtesting. As the Make Change 
^series entered the final stages of Initial fleldtesting at the^. beginning of^ 
this year, error data indicated the need for major . rewrl ting of >nany , sec- 
tions of this program. In Its revised form (consisting of fdiir component 
programs), the Hake Chartge series will enter the final stages- of Initial 
fjeldtesting In the fall. \ 

Development of the Time TeJIlng program has proceeded according to our 
projected schedule and Is.ready to enter secondary fleldtesting with the 
opening Of public schools In September. / 
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* One new program In the area of primary level life skills (Clothes 
Fastening) was written this year and Is presently In the final stages of 
Initial f f eldtesting. It Is hoped that this program will be ready for 
editing "Snd mater la 1 production In the falK, 

Four supplementary programs were also written this year. Two of these 
(Shoe Lacing and Shoe Lace Tightening) represent extensions of the Shoe Tie 
program. Additionally, two sequences to teach the use of sImfSle fractions^- 
were wri tten -as extensions of the measuring programs. These four new 
programs are presently In the Initial ^leldtestlng s^tages and, should be 
recidy for editing and material preparation by the erd of Fall Quarter. 

During Team Ill's final year, then,. all but a few programs will be 
fleidtested In the'publlc schools. In addition to the supervision of this 
i^rocess, Team III whl focus Its efforts on the completion of these exemplar 
programs — writing any necessary revisions (as Indicated by secondary and 
final fleldtest data), and producing all needed materials. Thus^ by July 
1975, Team IN expects to be able to deliver many of these programs, In the 
form, of complete Instructional packages, to MIE for general dissemination* 

Finally, next year the members of Team III wfll be able to review and 
evaluate the prototyplc model as It has been employed and refined In the 
development of these programs. Strategies for the dissemination of this 
final model will be planned and Implemented In the 197^-1975 academic year. 



^ Refinements of the Prototyplc Model , » 

During the past year. Team Ml followed the prototyplc model sequence 
In continuing the development of several Instructional programs. Data 
gathered from these programs clearly support the efficacy of this approach 
to Instructional programming. V/htle the conceptual structure of the model. 
reiTialned Intact, the need for refinements of certain specific procedures 
/became evident as they were put Into actual practice. These refinements 
\should serve to mak^ the model more efficient and broadly applicable. 
Further evaluation through'actual application will be undertaken next year. 
In this sectljtifi, our findings will be discussed In terms of their specific 
Implications (either validation or needed refinements) for each of the - 
major componelits of the prototyplc model." In the final sectt^on of this 
report, each of the l^jdlvlduai programs wlLl be discussed In detail. 

Possess Prerequisite Knowledge 

In addition to the specific skills already suggested, there Is sc>fne 
Indication that InstructloTtal programmers can successfully Implement these 
procedures only If they possess certain other, jmore elusive qualities. 
These qualities Include a commitment or willingness to persist In the often 
tedious task of writing and testing numerous revisions of each lesson. ^ 

Make Primary Decisions 



Specification of the area to be programmed and the target population 
was an Important , step In the development of. all Team HI Instructional 
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programs. No problems were encountered with this component of the"" prototypic 
model; It remains unchanged. 

« 

Devel^ Lattice for Instructional Program t 

Several aspects of the modified lattice system adopted by Team III 
were validated in the past year. The prediction tnat the modified lattice 
system would provide a |^lex{ble approach to task analysis, and could be 
adapted to a wide variety of skills was clearly sup^orted. Successful 
programs with target skills such as shoe tying, time telling, and metric 
measurement ^e re developed from a lattFced skill sequence. In one case 
(time telling), when it was decided to limit the program to a narrower 
terminal §oal, the lattice was easily modified tQ reflect this change. 
(For further discussion, see section on Time Telling Program.) 

Secondary fleldtest data from the Shoe Tie Program tended to support, 
the validity of entry behaviors as discriminative predictors of students* 
abilities to successfully complete an Instructional" sequence. The shoe " 
tying pretest was administered tfo a small sample (W»5) of severely multiply 
handicapped students ranging In age from 3 to 4-1/2 years. Of these, only 
one, a 3 year old autistic girl, demonstrated mastery of all the necessary 
entry behaviors. On the basis of this student's performance on the first 
four lessons, the classroom teacher was convinced that Jhe girlcould have 
<=°J]]R^eted the entire instructional sequence. The program was not. In fact, 
cop^leted, due to time pressures and severe behavior problems, (For further 
drscussion, see section on Shoe Tie Program.) ; 

Team III hopes to be able to further analyze the predictive and discri- 
minative values of the "Entry Behaviors" criterion for prbgram placement 
(as opposed to such commonly used criteria as chronological age and mental ' 
age) through a carefully controlled research ^tudy next year,' Due' to. Its' 
relative brevity, it would seem that the Shoe Tie Program would be parti- 
cularly appropriate for such a study. Furthermore, It is probable that 
students of widely varying chronological' and mental ages, who do not know 
how to tie their shoes, could be found and matched on the basis of entry 
behaviors alone. 

Inforyal observations at the EEU support the prediction that the 
lattice c6mponent of the prototypic model would prove particularly appli- 
cable for the classroom teacher. The practical value of the modified 
lattice was demonstrated in two ways during the past year. First, it was 
found that classroom teachers at the EEU were able to master the techniques 
of lattice construction through Independent reading of a working paper, 
written by the Team HI coordinator, which explains this procedure in ' 
detail. (A major portion of this paper has been included in the introduc- " 
tion to this, report.). Thus it appears that Che process of training teachers 
to use a lattice system for task analysis need not be prohibitively expensive 
in cost or time... Furthermore, those teachers who learned how to construct" 
instructional laittlces, and then employed the modified lattice system in 
their classroom^, reported that this procedure greatly facilitated the 
planning of effective lessons and materials. It appears, therefore, ttot 
the lattice can serve as an efficient aid to programming when time or money 
does not permit implementation of the entire prototypic model. 
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Final Pretest Package ^' ' 

Pretests for severaj of Team MPs Instryctlonal programs were revised 
this y^tar. None of these revisions Involved changes In the fundamental 
pretesitJ component of the prototypic model. However, certain practTcal 
refJneiT^snts of actual procedures have fad ? Itated* Implementation of this 
step. It became evident, for example, that in many cases teacher direc- 
tions needed to be condensed and simplified In order to give more con- 
sideration to the real limitations of teacher time. Thus the directions 
for administering and scoring the pretest for the Ruler^Measurement Program 
were reditoed from 3 to 1-1/2 pages. SImllaY revlslons^ere made In the 
shoe^tylng pretest, while the pretest for fastening skills was condensed 
from 3 separate assessments Into one comprehensive pretest. Feedback from 
fieldtest administrators Indicated that these revisions have" Increased 
program eff leniency. * 

It is probable that many students in a classroom demonsfrate mastery 
of some, but not all of t^e target skills assessed iri a pretest. Therefore, 
a major , component of the teacher directions for each of the pretests de- 
veloped by Team ill is the data analysis section. Thin section explains to 
the teacher the specific lmp4lcatlons of a student's performance in terms 
of difrerentlal placement at appropriate levels In the Instructional pro- 
gram. This year. In an attempt to achieve greater accuracy and clarity, 
tbis portion has been revised and rewritten for many Team III programs* 
Val idatlon and revision of these sections, however, mUst waltxintll data 
have been collected from the larger* secondary fieldtest samples which 
include students who are differentlaljy placed in the programs on the basis 
of' these. Instructions. In addition*, the formats employed In these sections ' 
are stlH not completely satisfactory. It Is hoped that next year a less 
cumbersome but still sufficiently detailed pr^edure can be developed for 
presenting this Information. 

Data collection p^rocedures for -^e/eral of the pretests were also 
re'fined this year. Team Ml researchep found that student ability was 
more readil/ assessed when recording of data was more discreet. Tnus 
several revisions were made to render the dSta collection process less 
burdensome and obtrusive: a) responses to be scored viere Identified on the 
data sheets by short descriptors, rather than simply responsjf numbers, to 
a>/old confusion In recording responses;* b) time data were eliminated for • 
those responses on which rate* did not show a significant discriminative 
value; and c) data sheets-were printed oh 5 x -8 Inch cards which may be 
scored in the administrator's lap. 



Decide on ^Program's Fonnat 

The programs deve*foped by Team Hi were all designed for administration 
on a one-to-one ])asls. ' No attempt was made to design a program^^using a 
teacher! 6s s/.br a' small group^ format, nor is such an attempt anticipated. 
Howe^ier*, it seems, that, el ther ^format could be employed with equal success, 
and there is no reason to question the validity of thjs step In the proto- 
typic models \ 
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Determine Initial Fieildtest Population 

In selecting subjects for Initial f leldtesting, Team III found It 
useful to fnclude subjects possessing the entry behaviors assessed by the 
pretest, but of varying ages* Although not previously Included In the 
entry behaviors, some specific aae^related skills which may affect a student's 
performance In this pfogram can be Identified* For example, when the Shoe 
Tie Program was administered to several preschool children at the EEU, the 
motor skills of pinchlnr and pulling against tension were often lacking. 
This problem was not encountered In earlier f ieldtestlrig, which Involved 
^older students. In such a situation, the programmer has two choices: 
either add the skill to the list of entry behaviors, or add the necessary -\ 
lessons to teach the missing skill. In the present example, **Pulllng -c 
against tension" was added to the lattice as an entry behavior. In con'-rast, 
the ability to plnch^ which was originally listed as an entry behavior, was 
found to be lacking In many students who possessed all the other prerequisite 
skills* Therefore, pinching movements were added to the lattice as a major 
Sj^bgoal and lesson frames were written to teach these movements. Thus 
selection of a varied Initial fteldtest population was found to be Important 
in evaluating the predictive accuracy of the entry behaviors criterion 
established for a given program, cis well as in evaluating the efficacy of 
the actual' lessons* 

Initial Fieldtest i 

The most significant refinement of the prototypic model occurred in 
the Initial Fieldtest section. This refinement Is reflected In the revised 
procedural lattice presented In the Introduction to this report (see Figure 
1)* This step was originally conceived as a single process, consisting of 
concurrent writing and f leldtesting by the programmer. The ''Begin Program 
Writing'* component of the original lattice reflected this conceptualization 
-(see Figure 9) . 

team 111*5 experience this year, however. Indicated the need for a two 
phase approach to this critical step in the development of Instructional 
programs. This dual conceptualization is portrayed in the revised procedural 
lattice for instructional program development (see Figure 3). 

The refined model Incorporates the original ''Begin Program V/rlting" 
step as the first pljase of Initial f leldtesting. As can be seen froqi the 
lattice, a second phase Involving additional administrators and subjects 
has been added. This revision was made for several reasons. First, It was, 
found that frequent rewriting of lessons by the programmer during the first 
phase necessarily resulted In a rather fragmented application of the lesson 
sequence. Thus the heed for further Initial f leldtesting of the entire 
Instructional program, containing aP of the rewritten lessons, became 
apparent. Furthermore, It became evident that there was a need to include 
one or' more* col leagues as administrators In order to provide a check for 
programmer error, as well as for clarity of teacher directions. Finally, 
the addition of the second phase allowed for the Inclusion of a wider range 
of subjects at the Initial fieldtest level. The Importance of this aspect 
of initial fieldtesting has already been discussed. (See Determine Initial 
Fieldtest' Population.) 
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Spec! fic -procedures which facilitate the actual task of writing effective 
lessons were also refined. As with the pretexts, It was gecessary to 
condense and simpU^fy teacher direction^ in the pretest and the lessons. 
The directions were broken into smaM steps and separated by spaces. 
Program administrators have reported g-eater ease In follov;Ing directions 
which are presented In this way. Similarly, the inclusion of graph\Ic 
i 1 lustratjons in the teacher's manual has clarified the teacher directions 
fqr^-prtSgr^s involving motor skills (e.g.^ shoe tying, buttoning). This 
format can be seen In the sample lessons from The Shoe Tie Program, Included 
in Appendix A. ^ 

The 90^ correct criterion level for individual lessons used by Team 
Ml was supported by fleldtest data this year. However, a smaller tolerance 
for error on specific frames proved essential In^ maintaining this high 
level of correct cumulative data for all students. For motor skills, the 
mastery criterion of three conseci/ti ve, successful repetitions proved 
satisfactory. • \ 

Improvements have been made^thls year in the methods of data collection 
and display. The use of 5 x 8 Inch cards for data collection, as described 
in the section on {>reiest development, was introducecKfor iesson data as 
well. Additionally^ cumulative data sheets allowing the teacher to see a 
student's progress through an entire program wero developed for several 
programs. Examples from the Metric Ruler Mea:> cement and the Ruler Measure- 
ment Program are included here (Figures 10 and 



The process of data col lection for motor skill programs was simplified, 
for use in secondary fleldtest settings. Data are not needed for each 
response at this level of program development, fso the teacher is asked to 
record the student^s performance only on specifically indicated criterion 
responses. The **Shoe Tie Program Data Sheet** (included jn Appendix A) is 
as an example of this format for data collection and display. 

The tine telling program involves two types of student response: those 
elicited by the teachei^ in a tutorial situation, and those produced indepen- 
dently by the student .using worksheets. For some students there were 
distinct differences In the patterns of these two modes of responding. 
Therefore data for this program are now displayed on two charts, one for 
lesson responses and one for worksheet data. This procedure ^/is one which 
the instructional programmer should consider for any program Involving the 
use of worksheets as well as lesson responses. Copies of the cumulative 
data sheets for the Let's Tell Time program are Included here (Figures 12a 
and 12b). 

Secondary Fleldtest 

Although only one program developed by Team til (The Shoe Tie Program) 
has actually been suomitted to secondary fleldtest Ing, several others are 
now ready to enter this stage. To date, only one significant problem has 
been encountered in the implementation of this step of the prototypic 
model — the selection of teacher^s to admi nister ,the programs ifl secondary 
fleldtest sites. Specifically, the problem was to locate a sufficient 
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number of teachers. In appropriate educational settings, who have both the 
time and t\}e commi tment^tto administer these programs In accordance with the 
pfrogrammer' s exact specifications. Rigorous adherence to the correct 
procedures for administration. and data collection Is essential If this step 
Is to provide the types pf valid information needed 'by the programmer, 
this problem appears to have been fortuitously resolved for Team HI next 
ye^r. Due to the funding of a new grant at the EEU, access to a large 
niimbei* of special educatlcin teachers In cooperating public schools has been 
facilitated. However, for general appl Icatlon. of the prototypic model. It 
seems that some consideration heeds to be given to -the posslbllLty of 
providing contingent reimbursement (e.g», tuition credits, teacher aide 
•tlme,^ money, etc.) for secondary f I e Idtest personnel . ' 

Final Fieldtest of the Entire Program 

^^s none of the Team Ml programs ha^ yet completed the secqndary 
fieldtest stage, it' Is not possible to evaluate the efficacy and efficiency 
of the final fieldtest of the entire^ program. It Is hoped that several' 
programs will reach^,th!s stage next -year, allowing for validation or needed 
refinement of this component of the prototypic model. 

InVtructlonal Program Developed for Specific learning Task 

I ' " ^' " " --IT 

. No Team III program hai yet reached this stage of development. ^ 
However, one area of concern which Is already foreseen relates tp the 
dissemi natlbn of a completed program. The instruct! ori^l programmer, con- 
cerned wjth the most effective dlssemIi:iatlon of the program, should begin, ^ 
early.to investigate a variety of avenues for dissemination. Some, vehicles 
for dissemination might Include governirient clearinghouses, regional Instruc- 
tional materials centers, commercial -publishl^hg ^companies, or the sponsoring 
agency itself. Considerations, such as qost and- complex! ty of program 
materials, range and number of students fo.r whom the .program is potentially 
applicable, and any legal restrictions due to source oF res€i^arch fundlag-^ 
will influence the programmer's decision Jn this matter.^ Ur^Ichever^ avenue' 
is eventually selected,. the'declslon , is an Important one and deserves 
serious ^ttentPon as a nev7 program enters the final stages of development. 



.Application pf the Prototypic rioclcl: 
Ins'ti^uct^ onal Prpgram Doye-lopment- . 
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\ The preceding sections of this report dealt with the focus of Team - 
ilMs research this year: the prototypic model ,f or curriculum develojiment, 
Detail^'d descriptions of each major component of the model were prese.n ted. 
Add! ti0ffai iV , the implications pf th^ls- year* s research were^discussed in 
terms of validation or needed refinement of each component. ' : 

In this final section, attention Is turned j:oward the'davelopment ^pf\ 
the individual Instructional prp^rams which'^er^yTed as the Vehicles through 
which ^thlsi model was evaluated and refined. For each program developed by 
Team Ml, t,he following Information Is presented: a) the terminal goal and 
target population of, the program) b)- the skill sefquence which Is taught In 



r 



the program; c) the pretest procedures employed In the program; d) the 
lesson procedures and materials developed for the program; e) the results 
of thif year's f leldtesti ng; and f) the program's current status. 

The following features are common to all Team III progra.Tts. 

1. ^?or all these. programs, the target population is defined i.n 

terms of entry behaviors and learning characteristics.' Ub 
program developed by Team III Is specific to any particular 
chronol3gi(tiil or mental age group. 

A ' 

/ 

2. */ The pretest for each program Is (.:^signed to assess the student's 
/ b^sal skill levej for both the entry behaviors and the major 

goals of the program. 

r > 

.J 

The teacher^s role Is clearly specified in all Team Ijl programs. 
'Direction^, criteria, ari materlajs are all provided. Statements 
to.bfe made by the teacijer are. printed in capital letters and 
* coi^re'ct student responses are defined. 

These progrants are carefully worded and structured so teacfie/^ 
aideSj volunteers, and helpers from other classrooms can ser^ve 
as administrators. 

The format selected for all these programs requires admini- 
stration on a one-to-one basis. 



The Shoe Tie Prog rani 



Terminal Goal and Target Population 

The goal of the Shoe Tie Program is to teach the student to tie. his 
shoes. Suppleniental lessons have been written, although not yet completely 
f felcft^sted, to teacH the auxiliary shoe tying skills of shoe lacing and 
shoelace tightening. The prerequisite skills required of the student are 
thd abilit;fies to Imitate others, grasp, and pull against tension. It is 
questionable whether Individuals with poor motor control will oe able to 
complete thfs program. A more definitive statement cannot be made until 
such individuals are assessejd by the pretest. 

Ski } I Sequence 

The Shoe Tie Program follows a skill sequence which progresses from 
pinching movements to actually tying a t?ow-knot orx a shoe while It is being 
worn. This sequence is graphically portrayed In €he lattice for Shoes Tied 
(see Figure 13) This lattice represents a substantial revision of the 
original task analysis for Shoei On and Shoes Tied, which served as a 
blueprint for the first three versions of the Shoe Tie Program (see Figure 
1^). 
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Several changes were made In this lattice during the past year. The 
task analysis was expanded In two ways. First, s;ince many subjects possessed 
all entry behaviors except for the proper pinching movements. It. was decided 
to treat this skill as a majo^* subgoal of the Instructional program^• 
Second, It was found that the major subgoal, *'1/2 knot tied,** was more 
complex than orlglrjally conceptualized. Therefore,, the enroute objectives 
for this skill were broken dovn Into more specific components. Additionally, 
three of the original entry behaviors were changed: a) "Can pull" was 
refined to "Pull against tension ," because fhls proved to be a critical 
distinction; b) "Concept of around" was deleted, because It did not prove' 
to be a significant discriminative factor; and c) "Can pinch" was deleted, 
because the program was revised to teach ^1:hls skllK Finally, those com- 
ponents of the lattice dealing with "Shoes On" and' not "Shoes Tied" were 
deleted, as they did not relnte to the specific terminal goal of this 
program. 

Pretest Procedures 

The pretest for the Shce Tie Program consists of five sections. 
The Information collected through this pretest answers the following questions: 

1) Is the student ab^e to tie a shoe? 

2) Is the student abte to untie a shoe? 

3) Does the student have the fine motor proficiency 
required to strimj beads wTth either hand? (The 
proficiency criterion for this skill has been 
set at three beads strung within 30 seconds.) 

Is the student able to pinch a slioelace? 

5) Is the student aMe to pull a lace against tension 
with either hand',* 

6) Is tKw student able to lace a shoo.? 

7) Is the student a>le to tighten the laces on a shoe? 
3) Is the student able to put on^^a shoe? 

^ f> 

Thus, an analysis of the pretest data reveals not only 
whether an Individual has the prerequisite skills for entrance in the 
program, but also whether ie has already mastered skills taught in the 
program. In the latter ca'ie, the pretest data facilitates the placement 
profess. The data sheet developed this year for thje shoe tie pretest Is 
designed to fit on two 5x0 inch cards, which can be placed In the teacher'^ 
lap. This form Is divided into five sections corresponding to the five 
pretest sections; each expected student response Is labelled with several 
identifying words (see Ap( endix A), 

Lesson^ Procedures and flat'^rlals 

The lessons In the Shoe Tie Program are presented in the three oolumn 
format described earlier In this report.' In this program, however, a 
fourth column Is Includec for graphic Illustration. (Appendix A includes 
sample lessons from this jxrogram,) 
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The lessons f»^^s prcgrarrr correspond to the components Identified In 
the task analysis, as represented by the lattice for Shoes Tied (Figure 
13). Since the use of a backwards chaining procedure Is most appropriate 
^n 3 program designed to teach shoe tying, portions of the latticed sequence 
are taught in reverse. In Lesson #3, for example, the student tightens the 
bow already tied by the administrator. In Lesson #5, the student pushes 
the second lace through and completes the bov/ already started by the admin- 
istrator. In Lesson #8, he tightens the half-knot (already tied by the ^ 
administrator) and completes the bow.. Finally, Tn Lesson #10, the student 
ties the, entire bow-knot. 

c * * 

In addition to changes corresponding to fhe lattice revisions previously 
discussed, many Individual lesson frames were refined during the /past year. 
Sections of the lessons were condensed and rewritten for greater clarity. 
Remediation suggestions were written for lessons which produced consistent 
types of errors for some students, but not for others. Finally, a three 
lesson version of :he program, which was written to meet the needs of 
students already possessing most of the shoe typing skills, but needing' 
remediation, was discarded. This short version proved to be unnecessary, 
because' the researchers found that the revised program's 11 lessons are 
easily adapted and combined to meet the needs of most .students . 

The only new material developed this year for the Shoe Tie Program was 
the "Remedo- Board,** This devfce was constructed because many students 
nearly '-eady to begin the sequence did not have the necessary pinching and 
pulling skHls for the. shoe tying process. The *'Remedo-3oard" Is a.s^lmple 
device designed to familiarize Students with the pinching and pulling 
motions used to tie shoelaces. It consists of a piece of wood dr 1 1 led wl th. 
"^two holes in which knotted shoelaces are secured for practicing .these 
motions. 

Two additional refinements were made to. render this program more 
manageable for the classroom teacher in a secondary fleldtest setting. 
First, an IJlustrated glossary of terms was added to the beginning of the 
teacher^ s' manual , explaining the specific terminology and movements employed 
In the lessons. Also, a new data- sheet was developed which requires only 
the scoring of criterion responses for each lesson. A copy of this form 
and an, explanation of the scoring procedure used ^/lth It are included in 
Appendix A, 

Initial Fleldtest Results 

Subjects . At the beginning of the year, six students at the EEU 
participated in the s>econd phase of Initial fieldtestlng of the Shoe Tie 
Program. Four of these students were children enrolled In the Down's 
Syndrome Kindergarten program; two of jthese youngsters were five years otd 
^and the others were six years old. The fifth subject, from an^ elementary 
classrooc was an eight year old cnild, diagnosed as mentally retarded 
with behav ;ol problems. The sixth student was an I8 year old emotionally 
disturbed young man In a secondary clclssroom. These students represent a 
cross-section in chronological age, men**al age, and motor control. 



Procedures . The Shoe Tie Program was under the immediate supervision 
of Mike Roe, one of the Team III interns. Five instructors administered 



the fn-house testing. Two of the five were Team ill members; the remaining 
three were project or field study students working under the supervision of 
Team ill. - . 

9 , 

Lessons provided the instructions used during the in-house testing. 
Any additional instructions or clarification prpvided by tjie instructors 
were ei^er incorporated into the lessons or were added as possible remedia- 
tion meCTHsds. / 



Results. One of the four kindergarten students, J., successfully 
comp eted the entire Shoe Tie Program in 21 sessions (Figure 15). After H 
sess ons, 5 year old P. completed all but the last lesson, which teaches 
untying. The instructor reported that this boy had great difficulty in 
Lesson #10, which requires the student to tie his own, rather than the 
model shoe. It was? not possible to obtain the parent fol low- through j at 
home. needed- to ovet'come this problem; therefore, P. did not finish the 
lesson sequence. ' j 

neither of t-he two remaining kindergarten subjects completed this 
program. Problems of absenteeism, uncooperative behavior, and changing 
administrators each quarter may account for the program's failure t? teach 
these students to tie their shoes. The data for one of these students. K. . 
are presented in Figure 16. 

I 

The 8 y earmold student who participated in initial f leldtesting, J., 
successfully completed the entire lesson sequence lo 11 sessions (iPigure 
(c- loi "''^ subject, T., learned to tie his shoes in 7 $essions 

VMgure ly;. Doth of these students entered the program at Lesson'#3, 
having demonstrated proficiency on the pretest In the skills taught by the 
tirst two lessons. 

Discussion . The data Indicate that this program Is effective in 
teaching the skill of shoe tying to students who possess the necessary 
entry behaviors, regardless of chronological age. There was a great 
difference, however, between younger (ages 5 and 6) and older (ages 8 and 
lo; subjects in the number of sessions needed to achieve skill mastery. 
There is some question as to the practicality of this program for very 
young children, given the limited amount of time which a teacher has to ' 
spend with this age group (usually in school for only one-half day). 

f ij'^ 's vossible that ^ome of the problems encountered in the initial 
rieldtestihd were directly related to the factor of limited student rapport 
with Che uafamihar administrators. The impact of this factor can be more 
accurately/assessed after the program is fieldtested with young children in 
the pub ic schools. Since the administrators in tf\e secondary fieldtest 
sites will be teachers or paraprofess ional s with whom rapport can be assumed, 
tnis factor would not account fot any slower progression through the shoe ^ 
tie lessons. 

The importance of parent cooperation was underscored^^^the case of 
one child whose parents continued to tie his shoes for him at home. This 
chi d learned to tie the model shoe, but never successfully applied this 
skill to independently tying his own shoes. 
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Secondary Fleldtest Results ^ 

Subjects , The Shoe Tie Program is now being f ieldtested on a. large 
number of handicapped students, ranging In age from 3 to 13 years old. 
The6e students are all^enrolled In pubJic school special education programs 
In the state of Washington* 

Procedures . DurTng the past year, the' Shoe Tie Program was used by 
many different administrators. Including teachers, high school volunteers 
and student teachers. Procedures were Identical to those employed In 
Initial f f eldtesttng, except that administrators had minimal contact with 
the programmer. Therefore, t^e .Instructions found In the Shoe Tie Program 
manual provided the only direction for administration of the lessons. 

Resul ts. Because this program dld--=not reach the public schools until 
^ late in the school, ye^r, very Irttle ,of the secondary fleldtest jdata Is 
assembled. As previously discussed, results have been received from one 
teacher who administered the pretest to five students, ranging In age from 
3 to ki years. Of these, only one student possessed all the necessary 
entry behaviors. Because this student demonstrated inastery of the skills 
taught in the first two lessons, she entered the program at Lesson #3. For 
two days, she successfully progressed through Lesson #3 and the first part 
of Lesson A. On the succeeding six days, however, the teacher reported 
severfe behavior problems (this child has been diagnosed autistic), and no 
further progress was'made. Therefore, the program was terminated for this 
child, although the teacher offered her subjective opinion that the child 
could have successfully progressed through the entire sequence had behavior 
not been such a problem. 

Additionally, two students In the same class who did not possess all 
the necessary entry behaviors (both required more than the allotted 30 
seconds to complete the bead-stringing task) were placed In the program on 
an experimental basis. One of these students successfully completed the 
first four lessons In as many days, but was removed from the program after 
seven days with no progress on Lesson #5. The other student achieved the 
criteria for Lessons #1 and #2, but was unable to complete Lesson #3. 

Data have also beenorecel ved from a teacher who administered the 
program to a 13 year old Down's syndrome girl who demonstrated alt requisite 
entry behaviors. Because this student was absent for 2^' weeks, she did not 
have time to complete the entire sequence before the end of the school 
year; she will continue the program next year. After 23 data days, however, 
this girl correctly completed all but one of the first 30 criteria (throujgh 
Lesson #9) . ^ . . 

Discussion . It appears that the entry behaviors for the Shoe Tie 
Program may screen out many preschool handicapped children. The efficacy 
of the program remains to he proven for those children who possess the 
necessary entry behaviors. However, the teacher who reported these preschool 
results expressed concern over the amount of time which would apparently be 
recjulred for these very young children to complete the entire Shoe Tie 
Program. She suggested that this expenditure of time may not be warranted 
in light of the other learning tasks which have greater priority for this 

ERIC ^0^/^06 " 



age group. Such 'a tentative conclusion would not be out of line with 
Team Ill's initial fleldtest findings. This problem will be giveti greater 
consideration as more secondary fieldtest data become available and plans 
are m,ade for final revisions. 

Although final results will not be 'available until next fall, It 
appears that the program was effectjve with one 13 year old handicapped 
•student Included In the secorfdary fleldtest population. This student's 
teacher was enthusiastic about the program and encpunt^ed no problems- In 
interpreting the directions as printed In the manOal. ^ 

Current Status , . ' 

, The Shoe Tie Program entered the secondary fieRdtestJ stage of development 
this year, but data for only a f'^w students have bee\ received, 'uhen the 
public schools reopen In September, secondary f l«ldteitlrtg will be res,umed 
and more data collected. Any necessary revisions will be made before the 
program \^ submitted to a final fieldtest. The program will then be prepared 
for dissemination. w 




Make Change Program 
Terminal Goal and Target Population 

The' Make Chinge Program consists of fbur separate, sequential mini- 
.programS^^ These programs and their respective terminal goals, are: a) Coin 
Discrimination --to discriminate by correctly naming and selecting the 
comnon coins; b) Bill Discrimination — to discriminate by correctly nami ng 
and matching-^^Mls of one, five, ten, and twenty dollar denominations; c) 
Honey Values -^^-to-ldentify by correctly naming, writing,^and matching the 
correct value for the common coins and bills of one, five', ten, and twenty 
dollar denominations; d). Coin Combinations --to compute by coun'^ing the 
value of all coin combinations through 25 cents. 

The Make Change Program is Intended for use with any student who 
J^possesses the following entry behaviors: addition skills, rote counting to 

100, counting from any number, shape discrlinination, and counting by 5's 
^ and 10 s. The mini-programs are written sequentially so successful com- 
pletion of each lesson's criteria serves as a prerequisite for the following 
lessons as well as the subsequent mini -prog rams. Supplemental remediation 
sections added to the program this ye&r Insure that the program will be 
applicable to students with general and specific learning disabilities. 

Ski]] Sequence 

^ V The flake Change Program follows the sequence of skill development as 
identified in the task analysis and displayed in the lattice for Make 
Change (Figure 19). 

The four mini -programs correspond to the first three major subgoais along 
the ridgeline of the Hake Change Lattice. This portion of the lattice is 
presented in Figure 20. 
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Upon completion of the first two mini-programs, Coin Discrimination 
and Bil, Discrimination, the student has mastered the enroute objectives 
for the first major subgoal, "Recognition of bills and coins by name.'* The 
third mini -program, Money Values, corresponds to the next subgoal on the 
rldgeUne, '^Recognition of money value signs.'* The last mini-program In 
this^ instructional sequence Is Coin Combinatfons, To date, lessons are 
written for only the first set of enroute objectives, "All possible combi- 
nations to 25c,'* under the third major subgoal, "All coin combinations 
(counting up)." The relationship between the mini-programs and the lattice 
for Make Change is shown in Figure 21, 

Pretest Procedures 

The Make Change pretest provides a comprehensive assessment of a 
student's ability to benefit from any or all of the four mini-programs. 
Specifically, the pretest answers the following questions: 

1) Can the student count from one to one hundred? 

2) Can the student fill in missing numbers in a r ^ 
sequence of numbers fronv/one to one hundred? 

3) Can the student count by tens and by fives? 
^) Can the student demonstrate shape and size 

discrimination ski lis? 

5) Can the student name the coins when presented 
face or back up? 

6) Can the student name the bills' when presented 
face or back up? 

7) Can the student recognize money value signs? 

8) Can the student make change with coins and bills 
up to $20 Inclusive? 

The answers to these questions enable tne administrator to determine 
whether a student already possesses any of the program's target goals, or 
whether he possesses the necessary entry behaviors for placement in the 
program. 

The Make Change pretest underwent substantial revision this year. The 
pret^ist sections were re-sequenced in a more logical ofder. The pretest 
was revised so it can be administered In two days, thus avoiding the tedliJm 
and fatigue encountered when the original version of this long pretest was 
administered. The Iv/o divisions of the revised Pretest are: .Part 1, 
Assessment of Prerequisite Skills for the Make Change Program; and Part II, 
Assessment of Proficiency In the Target Skills of the Prografn. 

Pretest section 10, which tests the ability to pfiake change, was widened 
in scope and re-worded to be more comprehensive and more easily administered 

(Bedause \t now seems necessary to limit the scope of the Instructional 
program to coin combinations only through 25 o>ats, further pretest revision 
will have to be made to reflect this reduced terSfhlnal' goal . ) The section 
assessing shape discrimination and fine motor ski?ls was sh' rtened with no 
loss in efficiency or predictive accuracy indicated by th^ pretest. 
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CORRESPONDENCE OF FOUR MINI-PROGRAMS 
TO THE LATTIC; FOR MAKE CIIANGE 
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The pretest data sheets v;ere also revised this year because the original 
ordering of sub-sections and the actual presentation of responses proved 
tpe awkward In actual f leldtestlng. The new pretest data sheets are similar 
to the originals. The need for a large amount of data on specific responses 
(e.g., which numbers tn counting or filling ?n missing numbers are missed 
or counted incorrectly) militated against trying to condense the data onto 
a card system. 

An important addition to the pretest this year was a new section 
placement. This s'ectlon tells the Instructor how to place- a student, on 
the basis of pretest data, at the appropriate lesson in the 'four section 
Hake Change Program. 

Lesson Procedures and Materials: Coin Discrimination ' 

The first mini-program in the Make Change Program is the Coin Ois.crifni- 
nation Program which consists of'six lessons. The purpose of this mini- 
program Is to teach the discrimination of coins used in our monetary systerrf 
to students who lack coin discrimination (as indicated by the pretest), as 
well as to students who require systematic remediation on this skill. 

The Coin Discrimination Program underwent substantial revisions in the 
past year.^ Fieldtesting of the original program at the beginning of the 
year revealed that the unlmodal approach (worksheets only) did not provide 
enough variety for sustained attention. Therefore, visual aids using 
colored pictures of coins were developed and incorporated into the lessons. 
Jhese aids provide a realistic approach to change making since visual 
characteristics of real money are more closely approximated by the new aids 
than by the worksheets. Another revision reflects the need for procedures 
to remediate confusion between a nlpkel and dime, and a nickel and quarter. 
Data from the original program showed that this confusion was a common 
problem so new lessons were written, tested, and revised. Finally, It was 
found that the v/ordlng of the original lessons needed substantial revision 
for greater clarity. 

In its revised form, the Coin Discrimination Program begins by teaching 
the student to visually discriminate between coins (penny, nickel, dime, 
quarter, and half-dollar) without attaching a' label to them. The student 
then learns to name and label the penny and nickel. The dime Is Introduced 
after the penny and nickel. New visual aids (cards plctuUng the coins in 
different positions) v ere developed this year to facili"tiate discrimination. ^ 
The student uses these aids, in addition to real coins and worksheets, to 
acquire the desired discrimination skills. ^ lie circles and names the coins 
on th^ worksheet as he learns them^ and matches the real coins to the 
pictured coins on the aids. ^ 

Once again, the student works with real coins pictures of coins', and 
wbrkslieets. *Skli!s are tested In a cumulative fashion so the student 
discriminates between and labels all ^ree coins: penny, nicke'l, and dime. 
The quarter and half-dollar arc introduced next. The student labels these^ 
coins using real coins, pi ture aids, and worksheets- UUh these aids, the 
student names and matches the coins.. Finally, a criterion test is Included 
to test the student^s ability to ldenxl\.V the fi;^e 'coins on reque^ti 
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In summary, the Coin Discrimination Program was rewritten this year to 
Improve clarity of instructions, provide new aids to increase ease in 
discrimination, present new worksheets utilizing color cues (i»e,^ silver-- 
colored coins vs» copper-colored penny), and include new remediation pro- 
cedures, A varied mode of presentation (worksheets actual coins, and 
visual ajds) wcs found to Increase the students' potential for better 
attending thrcughout the l^rogram.. A series of new remediatfon lessons was 
also developed to help the, student who experiences trouble discriminating 
between two specific coins (e.g., nickel and quarter). Finally, new data 
sheets were developed to fit on 5 x 8 Inch cards. 

Lesson Procedures and Materials; Bill Discrimination 

The second section of the Make Change SerPes teaches students to 
discriminate and Identify the one, five, ten, and twenty dollar bills. 
During the past year, major revisions were made in the wording of the 
lesson instructions and remediation sections. In addition, an improved 
method of matching bills with projected images of the bills was written 
Into the lessons. Further fleldtesting allowed some parts of the lessons 
to be '^abbreviated with no observed decrease In performance by the students. 
Data sheets for this mini-program were revised to fit on 5 x 3 Inch cards. 

The Bill Discrimination Program begins by teaching the student to 
discriminate visually between the one, five, teri, and twenty dollar bills. 
The student matches real bills (presented both face and back side up) with 
color slides of the bills projected to the -same size as the actual bills. 
The student first learns to name the one and five dollar bills as he matches 
them to their appropriate slides. Next, using, the same procedures, the 
student learns to Identify the ten, then the twenty dollar bills. Finally, 
a criterion test administered In the seventh lesson requires the student to 
identify the one, five, ten, and twenty dollar bills on request. 

i 

Lesson Procedures and Materials; Honey Values 

In. 'this min;-program> students are taught to Identify and write money 
value symbols (dollar and cent sign) and to use these signs in conjunction 
with actual numbers of cents and dollars. 'The student is also taught the 
equivalency of the various coins with their cents value — a penny Is equal 
to one cent; a nickel is five cents, a quarter is twenty-five cents, and a 
half-dollar Is fifty cents. 

This .year the Money Value Program underwent extensive revision to 
improve the sequencing of lessons and the actual content of many lessons 
because of error pile-up In initivJ fieldtesting of the original version. 
One lesson \^as replaced with several new lessons which teach. In Incre* 
ments, the skills of writing cent and dollar signs In isolation and In 
conjunction with actual nibney values. H6w vyorksheets were designed for the 
criterion t^st, the dollar writing section and the cents writing section. 
Also, the sequencing of several lessons was altered to maximize learning 
ef f ici en(^y. ♦ 

The first lesson of the Money A/^alue Program reviews coin discrimina- 
tion. The student then learns' to identi^'y and write the cent symbol (.;) , 



The student is also taught the value of each of the coins (a penny Is one 
cent, ^ nickel Is five cents, and so on up to flfty-ceint pieces*) The 
student then learns to write the cent sign with the appropriate number o: 
cents for each of the colns> using worksheets provided in the program. As 
the student learns to identify and write the money Y<3lues for each of the 
coins, he also learns to name them by their appropriate money values. 

/ 

After the student demonstrates proficiency in identiTylng and writing 
the money value of'coins, he Is introduced to tlie dollar symbol. He first 
learns to discriminate the symbol and then to write It in isolation. 
Finally, he learns the correct procedure for writing this sign in conjunction 
with n^jmbers and place holders (e.g,, $K00, $5.6o). The student also 
matches aids (depicting value symbols) to slides of the various bills and 
learns to identl^Py any of the bills on a worksheet when the corresponding 
value Is dictated to him. This mi ni --program concludes with a crfterion 
test which assesses the student's recognition pf each of the coins and 
bills, as well as his skill in writing the correct money value signs and 
$) In isolation and In conjunction with actual numbers of cents and dollars. 

/ 

Lesson Procedures and Materials; Coin Combinations 

"Phe final mini-program In the series i/b^th^ Coin Combinations Program, 
The purpose of this section Is to teach students to use coins In all possible 
combinations to make change. This section Is developed through coin combh- 
nations totaling tv;enty-flve cents; It consists of twenty-six sequenced 
lessons plus four criterion tests. 

Although some preliminary work on this section was accomplished during 
the 1972-1973 year, most of the lessons were developed during the past 
year, while previously written lessons were Initially fleldtested. .On the 
basis of the fleldtest results, severyajl lessons were rewritten to, Include 
the use of actual coins, or a combination of written responses and coin 
placements, rather than wrltt^sn responses alone. The researchers found 
that rewriting In terms of t^e actual use of real coins not only added 
variety to the sequence, but gave the student important practice In the use 
of real coins In the Uorning of coin combinations, flany lessons we're 
originally written fur the use of coin face rubber stamps which were found 
to be expensive lt<ams requiring close monitoring In cla^^room use. These 
lessons were rewritten to Introduce the use of actual c&tns In place of the ^ 
rubber stamp, tffus increasing the practicality of the program while decreasing 
its cost. 

The Coin Combinations Program begins by teaching the student to add 
several pennies. The number of cents is Increased by increments and, with 
each lesson In the program, practice Is provided In writing the number of 
cents with both a cent sign (c) and a decimal point (e.g., .04). The first 
few lessons teach coin combinations with pennies up to five cents. .Then 
the value of a nickel Is introduced and succeeding t^^ssons teach adding 
pennies to a nickel. \/hen all coin combinations up through fen cents have 
been taught using pennies and nickels, the dime Is introduced and Its value 
reviewed. Coin combinations to 15 cents using all Q*-evious possible coin 
combinations (pennies, nickels, and dlfr.es) arc thctf taught, -in a like 
manner, coin combinations up through 2i> cents are taught using all possible 



combinations of dimes, nickels, and pennies. Finally, the equivalency of «r 
quarter and tv^enty-flve cents is reviewed, and the criterion test Is pre- 
sented to assess mastery of all coin combinations up through twenty-five 
cents. ^ 

The final increments of a few cents per lesson proved practical for 
the slow learner who does not assimilate the change making process when 
larger steps are taken." The twenty-six lessons also seem appropriate for 
the student with poor adding skills who requires small increments and 
repetition th^t allows for over- learning, Uhen the sequence was us^d In 
abbreviated form for more advanced students this year (several lessons 
being skipped occasionally), the data suggested that the program adapts 
well to such use. Thus, the program appears to meet the needs of handicapped 
.students who have the requisite entry skills, yet widely varying abilities* 

^ Initial Fleldtest Resul<ts: Coin Discrimination 

Subjects . Two students completed the Coin Discrimination Program this 
year. One was an eleven year old boy considered to be learning disabled; 
the other was a thirteen year old boy categorized as mentally retarded. 
Both boys attended intermediate classes at the EEU. 

Procedures . The Make Change Program was under the Immediate super- 
vrslon of \/alter Berlin, one of the Team Iff Interns. As program writer, 
Walter administered the Coin Discrimination program to both suty^cts. 
Several revisions were made In the lesson Instruction:? because error pile- 
up occurred In the first administration* These revisions were Incorporated 
into the lessons which were used In the second administration of the program 
with another child. These revised lessons provided all instructions used 
in the second administration (i.e., no further revisions were made). 

Resu 1 ts . The first subject to go through the revised Coin Discrimination 
Program (J.) scored above the 30% criterion level for correct responses on 
Lessons 1,'2, 3» and'^^. However, errors exceeded 10% in Lessons 5 and 6 
and the criterion test, so each of these had to be readmlnlstered several 
times before the student achieved a satisfactory level of performance. 
J.'s cumulative data are presented In Figure 22. 

The revised lessons produced better results when they were administered 
to the second subject, fi. (see Figure 22). rt. completed the entire mini- 
program In eight lessons. Lesion ffS was administered twice; although the 
subject performed above the 30% criterion level, .',t- programmer felt the 
student should be able to respond correctly at the lOO!^ correct level on 
this lesson. V 

Discuss ion . The first phase of initial fleldtesting indicates that 
the revised Coin Discrimination sequence effectively teaches discrimination 
of the common coins used In our monetary system. Because the final revision 
was administered to only one student. It seems appropriate to continue the 
< first phase of Initial fleldtesting next year. 

r 
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MAKE CHANGE PROGRAM: COIN DiSCRIMIHATION 

Initial Fieidtest Data 
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Initial Fteldtest Results: Bill Discrimination 



Subjects . Three students received Instruction from this program. Two 
of these were the subjects Involved In fleldtesting the Coin Discrimination 
sequence, and the third was a ten year old boy considered to be both 
learning disabled and emotionally disturbed. All attended intermediate 
classes at the EEU. , ^ 

Procedures . During the first phase of initial fleldtesting, the Bill 
Discrimination program was adminlstereo three times — twice by the program 
writer and once by the other Team III Intern. The Instructions provided in 
the six lessons and one criterion test determined all procedures. Mo 
additional Instructions or materials were employed with the three subje^cts. 

Resul ts> Two subjects progressed through the program In seven ses'slons, 
never performing b-alow the 90^ correct criterion level • One subject, 
however, had to repeat both Lessons #3 and #A when he scored below criterion 
(50%correct and G0% correct, respectively) on the first administration of 
these lessons. The data for these three subjects are presented In Figure 



Discussion . The d?Xa from the first phase of initial fleldtesting 
Indicate this program Is effective In teaching bill discrimination. 
Students found the mode of presentation (slide projection) to be of high 
interest, and several students asked to have the program lessons repeated 
Immediately after the first run-through. The Bill Discrimination Program 
Is now ready to ibegin the second phase of Initial fleldtesting at the EEU, 
* with particular/attention being paid to Lessons #3 and "#4. 

4 

* 

Initial Fieldtest Results: Money Values 

Subjects . Five students particlpa»ted in this program: the three who 
served as subjects In the Bill Discrimination Program, a twelve year old 
boy considered to be learning dl sabled^^^nd an eleven year old, emotionally 
disturbed boy. All attended classes at the EEU. 

Procedures . The program writer administer^*] this mln^-program to the 
first two subjects. The program was then administered once by an under 
graduate student and twice by the other Team Ml Intern. In all esses, 
only the program lessons were us0d. No additional Information or Instruc- 
tions were provided. 

Re sul ts . All subjects achieved 90% correct or higher on each lesson 
of this mi nl--prograrK In several instances, however, this score was 
achieved only after the second administration of a lesson. ♦The mean data 
for these five subjects are presented In Figure Ih. The highest and lowest 
percent correct achieved Is afso included for each lesson. 

Discussion . The Emulative data reveal the high level of performance 
by these five students, despite their InKlial dls^)arlty in age and diagnostic 
category. Thus the data Indicate that this mini-program is effective for a 
wicfe range of students as long as they possess the necessary entry skills. 



57 



mi CHANGE PROGRAM: BILL DISCRIMINATION 
Initial Fieldtest Data . 
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MAKE CHANGE PROGRAM 
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Summary of Initial Fieldtest Data for Five Subjects 

Figure 2^ 



The flon^y Values Program is now ready to enter the second phase of 
Initial f leldtestlng. During this stage, particular attention will be paid 
to tMse lessons in| which there was a wide range in student performance as 
shown in Figure 2^.' 

Initial pfeldtest Results; Coin Combinations 

Subjects . Four students participated in the first phase of Initial 
fleldtesting for this section of the Make Change Program: the three subjects 
involved In the fleldtesting of the Bill Discrimination Program, and the 
twelve year old learning disabled boy who participated in the Money Values 
Program. All were students In Intermediate classrooms at the EEU. 'J^ 

Procedures . The lessons were administered to the first two students 
by the program writer. The other Team III Intern served as -{nstructor for 
the third student, and an undergraduate student conducted the fourth admin- 
istration. This last administration was not completed, due to the closing 
of school for summer recess. Therefore, after Lesson //O, data are available 
for only three subjects. In all cases, the procedures and materials used 
were those included In the 26 lessons and k criterion tests which compose 
this mini-program. Any additional Instructions were incorporated in sub- 
sequent rewriting of lesson frames and are included in the revised lessons 
for this mini-program. 

Results . The results of this phase of Initial fleldtesting for the 
revised Coin Combinations Program are presented In Figure 25. Again, all 
students achieved criterion for each lesson taught, i>ut in two cases a 
second a^lmlnlstration was needed to achieve this OOi correfct level on 
Lessons 1 and 26. Correct performance, remained above 30% on all other 
lessons, as well as the four criterion tests. 

Pi scuss ion . The very high level of performance by the four students, 
as shov;»n op the cumulative data chart, indicates that the program provides 
students continued success In learning to make change. The four subjects 
involved In this first phase of i»-'tlal fleldtesting represented a variety 
of chronological ages and diagnostic categories. It appears that this 
lesson sequence is appropriate for teaching change making skills up through 
twenty-five cents to students v/ho possess the requisite entry skills. > 

Since three subjects have successfully completed the entire Cojn 
Combinations mini-program, these lessons wlUJ be submitted to the second 
phase of Initial fleldtesting at the EEU in the Fall. 

Curresnt Status 

^ After, substantial revision, the entire flake Change Program was developed 
thriugh the first phase of Initial fleldtesting duri;ig the past year. 
Thus/ the four mini-programs which constitUyte this series will be subnitted 
to the second phase of Initial fleldtesting at the EEU next year. Because 
a new program wrl ter will take responsibility for this pVogram In the fall, 
somfe additional first-phase Initial fleldtesting may also be desirable. 
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^. The Time' Telling Program * * 

-» * * 

Terminal Goal and Targe t Population 

The terminal goal of the Time Telling Program is to teach students ^o 
read the time from a conventional clock (I.e., not a digital clock) to the 
nearest whole minute. In this program, the student is taught to use not 
only the formal "hour:ninute*^ convention for expressing time, but -al so such 
cbrmonly accepted phrases as "half past" and "quarter to". 

This instructional program is intended for use with any student who 
does not know how to use or tell time afid who possesses the following 
requisite entry behaviors: c^/ 

; 1* Number fecognltion 1-59 

2. Rote count' 1 - 5% ' ' / 

3. l/rtte numbers sequentially 1 - 59 

4. , Count 'by 5*s to 60 ^ 

5. „ Cojunt by ia*s to 60 

6. Discriminate between red and black ! 

In order to assure the utility of this program, v; I th students who have 
general or specif ic"* learning ;dlsabl l 1 ties, the lessons were designed to 
allow,fdr substantial overlearning and frequent review. Supplemental reme- 
diation procedu'res are provided for studeQts who need'^this extra assistance. 

Skill Sequence 

The lessons In the Time Telling Program follow the sequence of skills 
identified through .the task analysi^s graphical lydlsplayed in the lattice 
for Time Telling (Figure 7). This lattice represents an abbreviation of 
the larger lattice constructed by Team IM last year; which had a terminal ' 
goal of "Understanding Time" (Figure 26). Considerations of research 
priorities and limited time dictated the decision 'to omit the "understand! ny 
time" component from tTie instructional program developed by Team III. In 
»3ll other respects, th|s program directly corresponds to the skill sequence ^ 
displayed in the lattice for Time Telling. ' \ ^ 

P retest Procedures 

l)r^ pretest for the Time Telling Program serves t'vo functions. First, 
\t assesses a"" student' s basal skill level. Second, the pretest indicates 
where the student should be placed In the program, if the need for advi^nced 
placement Is indicated by the pretest jiata. 

. ^ 

The pretest consists of nine sections and requires approximately 15 
minutes to administer. Specific questions ansv/e>ed by each of J^hese sections 
are: ^ < - * 

1) ' Can the student identify the numbers from 1 to 12? 

2) Can the student count from I to 12? 

3) Can the student w *[.te the numbers from 1 to 12? 
^) Can th<'j student? count by tens from 10 to 50? 
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Can t^^1e^tudent cQtrm: .by fives frorn 5 to 55?' 
Can> the student iclen^ff^ the numbers frony 5 tp^ 55 by fives^* 
Can the studerft Identify tbe hour and minute han8^'?. ^ ^ 

* ^^"-^-^-^^^'^f^? .^student Identify the times shown on clocks' set to different 
^ intervgis of ^Ive mlnetes afteY each of the hoursY- 

9j '^G^n'the student write thC'-t^jhrieT^sfibwrr^^ cloaks set to different " " 
* ^ •Lr.lntervals of five mtnStes after each of the hours? 



During the ipast" V^sTj the Time Tel 1 lnf|^pretestt underwent .subs tan tl-al 
edltl-flP^ for the purpose of condensing and clarifying .teacher directions for. 
scoring and • Interpreftlng results of a student's performance.. The data 
sheets £oi^\th^ pre tes.f* were also revised to flt>on 5 IncfitCar^Js because 
the ortglnal fdrm^jjj^rovedvtoo cumbersome and obtrusive. No revl^sions Were 
made In the actual ^nten^t'^bf the pretest section^. 

tesscyi Procedures andsM a te r i a 1 s ' - • 

■ ' ■ ~ ' " • ^ 

^ ^* Thd Time T81 1 in^ Program consists of. five sections corresponding to 
the major subgoals of the lattice for 'this skllU The'Clo'ck Hand Discrl- 
nylnal^lon section con$iits pf 3 le¥sons which .teach the student to Identify 
the hour and minute harids. •The Hour Hand" sect4on, comprised* of 6 lessons, 
focuses on the hour hand I'p IsolatTdn. * The next sec.tlofi '^of 20 lessons. 
Minute Hand, teaches the minute hand, to the nearest whofe minute. In 
isolation*; * The* 6 lesson Tlfre ^ectM^n .teaches students "to tell time using 
' both the hour and minute handst The final sectlon/'Gross Minute, 'cons Is ts 
of*""5 lessons- wh I cfi -teach the use/)f non^ejtact phrases for expressing time,. 



The teacher's manual 'was* carefully, edited this year to- achieve greater' * 
clarity In the wording of d I ructions* for the administration of these 40 
•"lessons. No changes wehe' m^de In the actual content or sequencing of thfe 
lessons; ; ' / * / 

;^ The time tel 1 !ng program** s derta^jcpHectldn* and data display systems 
wgre modif ied this yea(r. The needj^or a more convenient and compact instru- 

^-ment for re.St>onse r^cdVdlng fjfas Ident^fi^d during the ihl tial f leldtesting 
of the program. \ As a result, the large 3 column data sheet wds replaced by 

' a new system which allows the adnrflnlstrator to Yecord responses on 5 x 8 
inch cards. -These clata cards are sufficiently rigid and small. enough to be 
scored I n the teacher*' s jap.-^/hey Have proven so satisfactory that they / 
have been adopted for most of Team' fl I '^s instructional prx)grams. ^ 

Analysis of inltl'al f Fildtest data indicated that many students dem^- 
str'ated two dlstlnqtly dlffe^euir patterns of correct responding — responses' 
elicited in a orie-to-^one tutorial situation, and' those produced Independently 
on, written worksheet tasks.' Therefore, /two separate percent graphs are , ^ 
used to display the cumulative data for .these distinct mofles of responding. 
The form developed to display this Information Is.presentpd In Figure -12. 

In addition to the teac)ier*^ manual ^ the Time Telll^fg Program' package 
consists of a student workbook and numerous aids. These mateffals represent* 
a carefully developed ahd tested sequei)ce of color and number cues* which ^ 
are gradually faded as the student progresses through the lessoni. Prior 
to the opening of school last fall, thesd materials had been produced in . % 
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large numbers the media' department at EEU./ Because tBe aids serve i:uch • 
^'critical role In -feljeV^fograrn, one more inltiarf ieldtestl-ng isras contlu,cted 
using the professlonally^p^oduced >^erslon^ pf th^ worjcsheets and plock* ^ ** 
a|ds* The p.urpo$e ,of the additional f leldtest 'was to check*^or aily chang-e ' 
it) effectiveness caused i>y thfs production proqess* " • . / ' » • 

^• Inltl^l Fleldtest R esults » . ^ \\ ^ ' * i 
1 « , « , ^ J. , , ^ ' ' / • . 

^ . Sybjec'ts; At 'the beginning of - the year.j^ t^io students werd. seleoCed ' 
from EEScJaTs rooms .to serve as subjects, for the last iQ-hoCise f leiate^ttng 

< of tlie Time TelVlng Progrgnr. One of these, an efeven VeaV *old boy with 
Down's synJirome, attended an Intermediate classroom, ."^ The othdr Isttjdent was 
a^ine^ear oVd g-l rl-^ lag nosed as emotionally disturbed, Dy JteacHeV request, 

• the proguam was also admfni^tered ^to'several students tn' I ntcf-modl ate and 
secondary *cfasses at^the EEU, .A fl -subjects possessed ^the requisite' cnuiy 
KeK^vlors, but tacked the»tlme tel 1 Ing- skilly taught In.t-hJs program. ' 

^ • . • - • ' ■ . ' ' ' 

- ProcedMres > The program was adm'inHtered to two students by i)r, 
treBorah Smltji, the program's writer, Ad^ I t'lonaT admlnl stratlOTs were 
conducted by classroom ^^acHers-at the EEU. Procedures specified In th^ 
^r(?gramMesson^ were adhered to strictly and tio additional Instructions, 
mare^rl~al^or relnforcejnent were employed. - ^ ^ * ' - 

Resul ts . Thd two 'subjects of Jthis fiel'dtestlng performed consistently 
^at or above,, tfie 90?: correct criterion level on all lesions administered,- 
One, of these sCuder ts dld^not complete- the prqgram because she vyas withdrawn;- 
,fr^ the EEU to rfet<>rn-to a regular ctass-/ " Xfie other subject completed the 
sequetice, althoMglf th"e*^xact> minute lessens were- oml t ted since he lacked > 
the pr^req^l^l te coiAtln^ skills. « v 

. '/The teachersjiwho administered fhe Time Tell Ing^Progf-atn in their own 
classrooms reported that'^thel r .students successfully^ completed the lesson 
sequ^e: Seveiral of these teachers- hive requested. the add! tlonal material s ■ 
needed to impl^ent this" ppogram with Htore pf their student*. 

. Discussion . The Tipra Jelling TProgtam w^s developed. through the second 
■phasf of initial- fleldtesting during tTie 1972-73 academic year., Hov^rever, - 
the rpess production of imperials fq.r 'dissemination to" secondary fleldtest 

^ites necessitated the use. o,f a proQuctlOn proces/ ditf'erent from that us6d 
to prepare the original set 'of Instructfonal ^nateri;aU for this pr'ogram. 
Before di St r I but tog, the instructional program pdck^^es jfor secondary field- 

/ testing', the program writer daeidfed to admjnlster the program, using these' 
new materials, to' two mofe i;«bjects af ,tlie €EU. Also, several E^ teachers- 

' q.dmlnlstered the programr to s^defe.ts In trffejr classes. ^. - 

The results Indicated that the new materials, used. in conjunction with 
the program lessons, are effective In teaching the/ skill of time telling to 
•students possessing the requisite entry behaviors. Furthermore, the progVam 
was- enthusiast'lcally received by those .teachers at thefEU who employed it 
}in their own classrooms this year. . Therefore, the 'pfogram lessoris were 
subrriltted to final -editing, and the ..teacher' s man«als*and new jlata/cards 
were prepared for mass prodUctl/Dnv , " ' . * 



Current Status ' * -"-^ ^ . ' • ; 

■ • • • , ■ • • , 

^^Kl^ Initial fleltrtest* stage of develogrttent. was cqfnpleted for'.the Tl^r^^ 
Tilling Program tbH year.: Instructional fnate.rlals and- student workbodks.- 
were prbduced^^n sufficient quiantlty tor sec&ndary fleldtjsting and s^es 
for thlj f I SI dte^C^ rig >/ore' selected. Howp.yen, delays encountered In. the 
^^prcductlon of^t^ach^r's manual s***^nd data cards prevented* tJie program from 
^^nter4ng-;the^ public schools this year. - Secondary fleldtestfng will begW 
as soon as schoql? re^^open. In' tKe f^ll. . . . /, 
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piothes^ Fastening Program 



Terminal Goal and Target Population • 

. 

Th^ terfpljjal goal of the Clothes Fastening Program Is^to enable a 
student to develop sufficient prof iclency the fastening skHls of button- 
ing, unbuttbhlng/ xlpplng, unzlpptng,. snappjng'and unsnappkig _to apply 
these >8kll Is .to his everyday dres'sfng and iindressjhg' nqeds. In-order to 
t^Sch tnese skrlTSj three ml nl-^prdgrams were wrjtt;en. The5e programs and 
their respective' t;^rmln^1 g6als are: '(a) zl pplng— tq Indppendently zip and 
•iinzip th|j front c^loslng^iof a garrn^nt while It Is being v^rn; (bl. s^appfng'- 
to independent ly'^sna^ and unsnap the front closing of a garment whll.e It Is 
being wornj aiid/(c) bqttqnlng^-tq independentfly buttnn and unbutton the 
front closing of d* g*arment whlle'lt Is being worn. " ^ ' 

Jhls Instructional program Is intended for usewlfh students^who have, 
falliBcl to learn tl^esie fastening s^l 1 IsC but possess the.foll,owtng entry ' 
.behaviors; ^ can jitftch, c5in puTl; can p\jih', can grasp,, and can Irtltate. ' 

^ ; . . ' ' / " 

Sl<1 1 ] Seauence ^ ' ' . 

^ • . \ ^ ' • > • ^ ^ 

The/jessons In this program^ correspond to the specific comp^elvt " 
skills identified through a systematic task analysis. ThJs sktlr sequence 
is displayed In'tfie lattice for "Unfastens and Fasten? Clothes^' (see Figure 

27). ' ; • . ; , ^ ... 

* ✓ * ' ' ' . 

. The present Instructional pft>gram does not encompass -every major ;^ 
subgoal along this lattMce rl.dgeMne. The specific' lattice segments which 
correspond to each of ih€ three mlinl-programs are presented Iri" Figures 20^ 
29,' and 30. 

- \ ' , . . ^ ^ ; ^ • 

The relative eff^lcacy fo^rwards versus* ba^lkwards chalnlpy of these 
fS^tening skills has not yet been fully determined. 'It. seems IHat-the * 
bacRwards Chaining approach to .prog^^ammlng will be^ most' effective for these 

^fine motor ^Iklllsl . If this prove?. *t6j be the case, tne/f^tnal lesson sequence 
wUl r^^present a reversal of portions of the lattice sequence (I.e., the 

;iast step In a particular motor chain would be taught first, etc-), as is 
tUe case with the Shoe' Tie Program. > • '* 
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Pretei^ Procedures 

t : * . • ' . ' ^ . ; . . > - 

The pretest for the Clothes./ras^enl ng Program .enables the admlnl^stratpr 
to decide Where, to »p lace ^ student. Ir the program,' or if a student a IreadV^^ 
possesses all' the fastening skfilSj-not to*place that studegt In. the pcogram 
at afK' As presently written/. the Clothes J^astenfrig pretest consists of 
seven sections which caiv be y^iidm?nl»stered/l1^ approximately ISimlnutes. The 
specif Tc questions ^nswere^by each^f^fhese sections are: 

* Can the studen^ fasten dnjl- unfasten hlS own coat? ' ' % 

" 2) Can the stucJent ,4IscHmfriate a cdat ,from^ other' I terns pf clotKlog? 
^ 3) - Can, the"* student po4n,t to the parts of hJs body which are . a " 

* referred^ ta In tRe verbal -direct lops for this prdg4?Qm (i.e.^ .arm, 
elbow, han^,* and head)? ' \. \ ^ * - } ' ^ ' 

A) . Can the s^tudent Imitate fthe teacher* s ^gross motor jrovements ' . 
'\ using aVms'and head? ' • - r * , 

5) Can the student* ilp, -snap, and Bjutton the appropriate f^stenlpg 
vests?",/ ^ . . ' 

^ 6> Can -jth^'student. string three.beadi with elthei; hand (l^e., does"^ 

• he Dos^ess^the f Ine motor skills of pushing and pulling, as . } 
' ' we/l as the eyerhaod coordination necessary, for clothes* fastening 
7) ' Cam the .student stand upright for the period of 'tjitie required 

to complete \t^e' tasks iTor this pretest?' - 

This program was conceptualized during the. past^year and Is currently 
In. the fli*st stages of initial wr^fing and f leldtesting; therefore, the 
pretest/ describee} here Is^tentati ve. It Is uncertain whether the skU.l 
assessed l^sectjon P-7j^tandIng upright for an cxtenrded period of time) 
J?s needed for successful* learning of fastening skills. The criteria for 
adeo^ate proficiency In fine motor and eye**hand coordlnattdh, as assessed 
through a bea^ stringing task, have-not yet been -specif led for this program, 

; Wesson Procedures and Materials ... 

The Clothes Fas^tenlng Program Consists of t|iree minl-prograros, all of 
which were, conceptual I zed sfhd written^Orfng the past year, instructional 
'materials for these prograrris wei;e)al:]5o*^eslgn<pd and constructed this year. 
At present, the entire program consists of • 17' lessons. ^ ^ \, * 

Zi loping Program . TRe Zipping Program Is comprised ,of five lessons. 
The first teaches the studer\tchow to ^uSh the'slldef down to'the end^>>f the 
zipper tracl^. In' the ^ second Jlesson, the student engages th^zlpper.by • 
hlm$elf^? and In the third he zlj^s It^up and sets "tfee talon soMt locks. In 
the fourth lesson, the student unlock^ the. talon, ^nzlps the zipper and ' 
disengages It. As presently wrl^tten, th^s,e, first four lessons call for^ the 
student to perform the tSsks on a zipper board*, .an lnst;ruct^Ional ald'found^ 
Irt rfiany preschool and. ^lnderga^ten classrobms. The fiftff lessen 'calls for 
the*student to apply -the skills taught In the first four lessons to pipping 
and unzipping* tlie front closure on a specially designed v^st 'wjth a large, 
Jacket-type zipper, \ *. . ^ , 



S napfif ng Program ^ The iSnapplng Program was also wrftteSi as a five- 
lesson sequencer . Th^ first four lessons, carl 1 for the Use of a snapping 
board. On^ this -board, the student first learns to press the snap clqsfed 
aftVr It has been correct I VLPpsItloned by.tbe ^idmlnlstVator* \ln the second ^ u. 
lesson, the' student learns "the correct method of grasping, the two sides of 
a sriap closure and completes, th^ snapping process. In the third, lesson the / 
Student mu?>t correctly position the two sides of^t^ie snap closure^^and ^ . 
complete the ©nltlre chalhV In the fourth |^esson;* the student, tearnsltp 
unsnap the/^board. Flna1,ly^, In the f If th -le^sow, the studeo*^ wear's a specially 
desl^gned //est and applies these skills to the snapping and un^napplng of, • 
the.ve$t< ' ' ' \ - ' 

- ♦ 

Buttoning Program . This mini -program consists of six lessons. and one 
criterion* test. The first three lessons Jnvcrlve the^ use of^a butt;oji board ' * 
and teach the following skfl Ts: *^ l) /completing the buttoning process by 
pylllng through each of .three buttons (Inserted hn the l?uttQrf holes by the 
Instructor); 2) holding the two sidfef of the bptton closure -^correctly and , 
tompletl'ng the buttoning pfocessj faf ter the instructor has poslttpned the 
two sides); and }): Independent buttoning of all three biiltons. InN^he next 
twb lessons, this Seqcience -Is-rep^ted as the^-student wears a speplalv^y 
designed button veSt with. a f r on t^"* closure consisting of three large buttons. 
* The sixth Lesjson teaches the stu^ient' to unbutton the yest' and. requl res' him / 1 
to demonstrate mastery of thls^sklll by correctly unbuttoning three con- 
secutive flmes. * f ' \ . 

^° Several major questions about this. Instructional program remain uAa/iswered. 
First, the relative efficacy, of forwards chaining (used In the lesson / 
sequence for zipping) and backwards chaining (used Ih the le.sson sequ^emces 
for snappjng and buttonIng)*needs to^be-determlned. - Ad'd'Itlbnal 1y , there fs 
, a' need to^ Investigate the efficiency of* teaching*^ these skIlls3on fastening 
boards before i.eachlng tJhe student to fasten a garment while It I5 being- 
worn. The original mlnl-grograms incorporated these boards 1)ecduse of ' - 
their common availability In many classrooms^. Since the visual and kinesthetic 
perspective Involved In fastenlnp on a board Is qult^ different from that 
gained when fastening on the^ front of one*s own body, problems encountered . 
*ln transferring these skills fr6m board tb Vest may outweigh the adycintages 
of first learning to perform these,-5)&Ms on a fastening board. Finally,- 
dfte to the learning characteristics of the target population fo? this 
pVogram,*'lt may be Impractical to assume generalization from a.ve^st to the 
chUd's^own clothing. Therefore, these ml nl-programis may, need to be expanded 
to Include specific Instruction on different types and weights of clptlrjng, 
sizes of . fasteners, and construction of .fasteners Je.g. , nylon vs. metal 
zippers*). . .." , . \ " \ ' 

' * y . ' • ' ' - ' ^ ^ 

Initial Fleldtest Results . ' ^ . 

• ' -* • * . , 

Subjects . Eighty students served ^as siil?jects In the first phase of ^-^ 

initial fleldtesting for the Clothes Fastening Program. These students, 

all 5 years old,> v/ere ^selected from the EEU*s Preschool for developmental ly • 

^'delayed children and the Down's Syhdrome Kindergarten. All demonstrated 

tRe hecessary*.entry behaviors bill dfd not have the fastening skills t-ught \ 

by* this program. j - > • • 
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Procedures , Lessons for each mini program were written to correspond 
" * .the sequence of steps Identifl^ through task analysis and displayed In 
' "the; lattice for Clothes>ast?enlng. As thl's^was the first phase of Initial 
fl-^ld testing, the Jessons were, rev! sfed and rewritten on a dally.basls In 
accordance. with |tudent performance data. ' , , 

V * Results , In Initial f^eldtestlng, student performance was highly 

V erratic and error pMe-up was often ertcou\ifered. Th?s Is not uncommon for 

the first V^f^'of^ 'of any Instructional sequence and. In fact, Is the 

ralson d^'etre for Team ll|*S highly structured approach to Instructional ^ 

; p r'og ham . dey^ 1 dpmen t » • l3fS\jthe baslu of the ^ata collected, the lessons* In 

' this program have been substant ' frequently rewritten.; As yet, no 

/^tucfen^t has sati sf^ctbrUy com ' ,u ,*s program" seque|)te; therefore,, no 

' * data-*^h i 'tee presy^nted'Ker'fe^i • 7 ^ * . * ^ ' 

' ' ; . ^ < ' ^ " * ' 

' Discussion , ' Initial' fleldtes^ results have 'ra!sed many questions 

► abouT the sequer\ce dn* materials employed in .thesfe mini -programs. A ^ 
'^ntedif/ied verj^\tff\ of the pr(^ram', ^slibstUatlng the use, of fa^tenln§ vests 
fo/ theTa-^^nijng bcJards ial led* for In' many^ lessons, will be included In 
.the ne>(t f leldte^tingv". Additionally!^ the merits of forwards and backwards 
: ' chainlhg^of these ski lis V/l U b^carefiilVy an^'ly/ed through further field- 
er - testing. ^ • ^ , ' . V • - ^ ^ 



Current 



The Ciothes f-QStehlrig Program Is.fin the first phase of initial field- 
' t^stlrt^. Because o'f the Velatlvec^bnevi ty of the three mini-program which 
.r^ak€^up thFs program; It is ariticlpatfed thatv^he fiVst phase fian be com- , 
t>let\d by 'the 6nd of Stimmer Quarter. Therefor^, the program should be 
. « ready, for the-^'^econd phase of Initial f l^eldtestf ng wh^n schdol reopens In 
the fall, , Thus it is reasonable to expect the Clothes Fasten irjg Pr^ram 



to 6ntQr the secondary f ieldtest stage next winter. 
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. ^ The RUler Mea^^urement Pt^ogram 

» » ^ \ ' " , ' ' . • • 

Terminal Goal and. Target PopuTati^n . 

/ "'J.-' r"r ' ' r . ^ 

'-The termln^ijl goal of^*the ifeler 'fle^urement Program Is to teach the. 
correct usfe of a^'l2*Jrich Vullr. Th^ threerold-goal is to teach the student 
to Xise the TuleV. rn thre^ ways: -1.) m^sufe line segments; ^2) .rule paper; 
and' 3) {dlv.ide llrte segments tnto equal parts. The pr<^gram is Intended for 
use. with any S^derft who lacks: these Vuler. measurement skills but who ' 
possesses the necessary entry behaviors. • ^ 

\/ The ^^erequl site sk^ll'lfpr the fl/st six sections qf' the program^ are: 
grasp motion; turn motlonVcQunt ^nd Identify pumbers from 1 to 12; precise 
usi^ of* pencU;. Identify ^i^uler; concept of\tpp and. 1)ot tort*;, conc^pf^of frac- 
tions; wrft^' fractions, Y/8, .1/4, 1/^* ^.AiCipplementaKlesson- sequence was^ 
written this yeaf to ceach these. friction' skills to -^itudents possessing the 
other* entry* fadhavtors. Ulth these, skills, a stu(lent may enter the sections 
v;hidh tea^h measuring line segments and rul;|ng 45ap0r{ bowever, these fjkills 



art not suf^lcfent to meet the goals of the fina^l'^two sections. The 
student must shoW prof Iclency »in simple .division by two and 'four to enter , 
the final ^sections on dlvicling line segments! The program is written so' 
that even those students who lack the skills necessary to compJete the last 
*two'sections nfey^nter and complete the first six sections.* ^ » 

Sis ill Seque'no , " ^ ' ' 

The eight"* lections of the Ruler Measurement Program (indicated by the 
criterion tests) corre'spond^ to ^he major subgoals along the rldgeUne of' V' * . 
the lattice for Uses Ruler, presented In Figure 31. *^Simi larly , .the content' 
and arrangement of the individual l-essons fol Ic^ the xSeq^ience of skiits or" 
en route objectives t'denttfted In the Initial task analysis. The ft * 
three sections teach the student to measure 1 il?^ segments to the nearest 
1/2, 1/4, and 1/0. inch, using a 12 Iqch xuler^-J^ The next three sections 
t-each the student to rule lines on a blank sheet of paper in the same place 
as the^ lines already drawn on a mode\. The final- two sections teach the 
s|:udent to divide line segments Into halves and fourths. The student may i 
-not enter any of these sections untl 1^ jtiasters the skills tau^t In the 
preceding sections. " ' / . * 

Pretest Procedures - . . . 

The Information collected through the pretest for the .Ruler Measuremept 
Rrogram answers the following questfons: 

1) . Does the student possess the fine motor control to grasp and turn 

a ruler?- ^ ' - ' 

2) Is the student .able to count from one to twelve? 

3) Is the student able to Identify th^ numbers from one to twetve both 
sequentially and out of ^order? ^ • - • ' 

h) ^ Does the student possess the fine motpr control to rtanlpulate a pencil 
through precision task^?- 

5) Does the student Understand the concepts of toptand bottorn?, ^ 

6) * Boe6 the student understand the concept of . fractions? 

7) Can the student wrl te .fractions? ' ' 

0) Does' the student have; simple divlson skills? , * ' 

•9) Does the student underf1;and the. concept* <^f the starting and ending 
• points bt a line ^egment? ' , - • ' 

10) ls,^he student able tb'mark off 1 Inch, 1/2 Inch, 1/4 Incb,, and I'^'O 
^ inchf increments of a llne^sing_.a ruler? 

11) Is the student able to measure line segments to the nearest lnch,r 
. ' , 1/2 inch, i/4"inch, and^l/8 Inch? ^ ' / ; 

12) - Is t.^e student able^ to rule paper? / 

13) Is the student able to divide line segments? 

An affirmative, response to eaqh of the first seven questlons/ls prei^equlslte 
to the student's entry Jnto tfj^^pfogram. Question .8 refers to .the additional 
entry behavior needed\fof placement In the last two sections of the^jprogram. 
Tlie last five questions correspond to the. major skills taught. In" the. prog ram. « 
' _ _ ^ ,» — *- ♦ 

Lesson Procedures and Material's . ' 

■ ■ ■* ■ ■ I ■ I ■ p I ■■■ - -iii^ p i 

The Ruler Measurement -Program, written -during the 1972-1373 academic 
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years con^^lsts of 36 lessons and 0 criterion tests. ' The criterion tests! 

spaced throughout the sequence, assess a student* s nraster/of specific, 
^.ski Ms. tatight. in preceding lessons. Successf^il completion (at least 90^ 
* fedrrect) of each crl terion. test is required before a student may progress 

to succeeding lessons. ' \ ' *^ . ' ♦ ' 

The lessons are written in the three column format described earlier 
\and are intended for administration on* a on^S-to-one basis.. Th^ program 
includes the use of two different types of instructional materials: • 'non- 
consum&ble aids (plasticized models and a sequenced set of plastic rulers), 
and approximately 150 consumable worksheets, ^ i 

On the/faasis.of the second phase initial fieldtest dat^^ several 
aspect;s of the Ruler Measurement Program were revised this year. However,* 
neither the nunfcer nor the^format of the lessons was altered significantly; 
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To increase clarhty, the teacher's directions were raised. Many 
remediations were added for lessons in which? specif Ic strident errors were 
repeatedly encountered. Addl tt.onal ly , dlvislonSlcl lis were no longer con- 
sidered prerequisite to entry into* the program. A student not having these 
ski I Is^ But meeting the other prerequisites', 1$ given instruction In the 
f|rs€*,six sections which coyer measuring line segments and* ruling paper. 
Thus students can ent^r and complete the program without having cbntact- 
with the^final sections. Finally, *the student r-espohse^ were revised In 
many Instances. The reseai;chers' found that breaking multiple responses 
down Into their component parts facilitated the administration of the 
program. 

Several new m^erlals were developed thls^ear. These materials 
included a few replacements for dot-to-dbts, and more Importantly, the 
revlsion\of three aids: L-13a, L-I6a, and L-ISa. The orlglrfals consl'itc^ 
of divided aids: one with 1/2 Inch increments, -one with l/^vipch Incre- 
ments, and one wfth 1/8 Inch Increments., Each new Inch was ^ni tljaterf^jSI th 
a colored space. The lines separating the spaces werfe a$ lonn*SftS the*wi^dtjy 
of the aid. • . ""fl/. 5 

The researchers fou'nt^hat the-llnes (all the isam u4il«g J 

the width of the ruler) separating tlie' spaces ^^ere conflicting ^o\th'e 'StudenT. 
The, student was unable to distinguish between thejl .^Tyli jVA, Snd 1/0. 
inch increments. The researchers, also iFound that the .ccflors^were unfiecessany 
In recognizing spaces. ' ^ " 



The new aids show Ifnes^of differing length^ separating the spaces. \ 
The lengths co^'respond )co the size of the 1 ncremeDti, ^'•9» llnc^ , 
designates*'! J nch, and the shortest line designates, x/8 inch.' This forma'|:. ' 
Is the same efs that found on a r^j^ular 12 Inch; ruler, the length' inc/ement 
of Interest Is set apart by darkening its ,boun<^i|ry Ijnesp^^ Thus )j^i§* fuler ^ ^ ; 
aid establishes increment size and Is easily-f^ed out tb be eyentuaf'ly ' J^' 
replaced by a regular .ruler.' •* ;/ ^ 



'The systems for data collection and displ'ay employed in the Rul'er 
JHeasurement Program were also refined this year. In tho interest of greater 
manageabi i i ty, . the data sheets were reduced to fit on 5 x 0 inch cards 



which can be scored in the teacher' s lap. Additionally, a cumulative data 
form was developed to provide a concise record of a student's progress _ 
through the-entlre program. ^ This form ellrtflnates the necessity of*going 
through all the Indlvldjial^data cards when, only a general overvl^xof the 
studentjs performance! 5 deilTM (e.g. , for parent 9onferences) and also 
provides a concise ^record for the student's permanent file. A copy of thisi 
form wds presented In Figure 10. ; ^ " , * 

Initial Fleldtest Results . ' ^ \ 

Sub jects. Throughout the academic year,' four students participated In 
tfte sedond phase of Initial f leldteslng of the Ruler Meastireitient Program. 
All were students at the EEU. One was an eleven year old boy with Down's 
syndrome from one of f he elementary classrooms. One was an eleven year old 
boy, considered learning disabled and emotionally disturbed from an Inter- 
mediate classroom. One was a,,twe1ve year old learning disabled boy In an 
Jntermediate* cl.assJ The fourth subject wasT a thirteen year old boy with 
l^earning and language disabilities. ^ ^ . 

Piocedures* ^ The Ruler Measurement^ Program was under the Immediate, 
supervlslpn of^ Mlk^ Roe, one of the Team Ml Interns, who administered *the 
T>rogram to three subjects. Walter Berlin, the otljer Team III Infern,/ 
served 'as 'Instructor for the fourth subject In the program. / - * 

» " *■ . * 

Xhe lessons provided the Instructions used durjng t4ils phase of mrtlal^ 
fleHtestlng. Any additional Instructions, clarifications or materials 
p'rovlde^d by the Instructors Wre either Incorporated Into the revised 
lessons or were added as suggested remediation techniques. 

: % ' \ ^ ' \ ' " : 

\ » Results . One of the subjects was withdrawn from scfiool and did not " 
complete the program. He had progressed through Lesson number 10, scoring 
100? corrdct on every lesson. The last subject to whom the prog ram. was 
■ administered did' not successfully complete the program for two reasons: D 
he lacked. ttie fraction skllls.whlch were later- made prerequisite to entry 
Jn^o the program^ and 2) lack of time due to the closing of schoo) for 
sCtfimjer, recess, which mad^ It Impossible to pVovlde the needed'temedlatlon 
In these skills. 

' ' \ >^ ... ' ' ' 

; TItus, only two subjects, f. and B., successfully completed the program 
this year. As nelth^ of^these students possessed division skills, the • 
last six l^ssons^'^^^^wo we^^ not administered. On entering, 

thei^ogram/ t. A\% not^ss^ss any fraction skills an.d thTs lac^ Is^ re- ^ 
fleeted In his Initial.. performance on Lessons number 15 through 22. A 
stu^plemental lesson seaoence to teach these skills was concurrently written 
arid admlnJstered to thiV '^^bject, enabling him to complete the measurement 
-lessons. T.'s dataf ^e presented ln\Flgure 32. 




; B., the^econb Cybject to complete- the program this ye^r, d< 
that he was proficient jri the prerequisite fraction skills on the'Ruler 
Measurement Pretest. This student J^as jble. to j^^^ the lessons ai^r 
4bVe the 90% crlprlon level on all but two days. , the administrator ' 
,repoKtea that b^ftavlor problems accountiejdl for the low number of corre<j't 
responses on thes^ two 'days. B.^s data are presented In Ffgure^33. 
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Discussion / The data from the second phase of Irrltialuf lejdtesting 
indicate It hat the Ruler Measuren)ertt Program Is effective In teaiihfng the 
skills of measuring line segments and rpling paper. Because nd student. was 
found at the EEU who possessed the necess|fy di^sion skHls^but was deficient 
In^ ruler measurement skills, the lessons whlch/t^ch division of line 
segments viere not administered this year. 'However, the. pr9gram is now 
being , prepared for secondary fleldtesting and it Is hoped.that: students who 
can benefit from the' line division lessons will be available In this larger 
population. ' ■ «o • . ^ - 

'^ 'Curr ent Status- • - 

— ' • • r 

'*-l>)e Rul^r Measurement Program, written by Team 1 1 i during the^igyi-^^ 
1973 academic year, has now been developed through the second phase of / J^* 

^ Initial fleldtesting. V\ Is being edited f-)r publ ication in an experimental^ ^ 
edition. , Mon-cdnsymable materials and consumable student workbooks are , ,^ ^ 

jjjel'ng produc^ (n .multiple packages. It ^s^antJc^pated that this work will 
be completed by the 197^ Fall Quarter, The oriparam wl 11 then be subm{'tt^d , 
to secortJdary f ie^ldtesttng In the public sch<»fs with a sample of ap>roxim&<ely 
50 subjects. / A supplemental lesso*n sequenc^Jfe to teach the prerequlslij^ 
fraction skttls for this program was written th^ls year. ' Second phas(i ' / * 
initial f^Ie^dtestlng will be cor.ducted for these lessons at the ^EEU^ during 
Fall Quarter. The fraction Vessbnswtll then submitted to secondary ^ > 
fieldtest in public schools, as supplements Co the PfUler Measi^menf Pro^fSm. 

' ' . ' ' * \^ -.K 

The Metric Measurements Program * . 
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Terminal Goal and' Target Populatloip ^ 

The terminal goal of^h'fe Metric Measurement Program is to teach ^e 
correct use 6f a thirty c^tlmeter metrl.c ruler. Specifically,* the student 
in this prc)gram Is taught to usd the mfetrfc ruler in three ways: 1) to 
measure I ne segments, 2) to rule pap^r, and 3) to dlvide\line segments . . 

/ ^. ^ ' ^ 

This program is Intended for use with any stu^aSnt who -lackss^hfe metric 
measurement skills and possesses the entry behaviors identified In this 
lattice. These prerequisite abjli ties are: grasp motion;' turn motion; 
counts ^nd Identifies numbers from 1 to 100; precise use of pencil; identify 
ruler; concepts of -top and bottom; concept' of fractions; wrl tes^ fractions'^ 
1/2 and 1/10. , These .skills areyiecessary for the completion of the flrsf^ 
six sections— measuring line segments and ruling paper. They are not 
sufficient, howeVer,> to meet the goals of the final two Vect ion^-*dl vldin^ ^ 
Hn^ segments. The Individual must show i^rof leniency In simple dlvlsldi^^byi 
'two and ten to enter the final sections. This program t^s written so that \ 
tho^e, stOdenfs who lack the skills necessary to complete \he final sectidn^ 
may^enter and complete the first six sections. . -\ ' 

Skill Sequence ^ ^ \. / , ' < 

The eight section^ of the Metric Measurement Program (indicated by tW 
criterion tests) correspond to the major subgolkls, along the ridgellne of / , 
the lattice for Uses Metric Ruler, presente^ In Figurii^3^. Simi larly, t)<e^ 
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Figure 3^ 
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content and arrangement of the Individual lessons follow the sequence of 
skills or enroute objectives Identified Mn tfie Initial task analysis. 

•The first three sections teach the student to measure line segments ^ 
using a 30 cenUmeter ruler to the nearest 1/2 and f/10 centimeter* In the 
process* the studentv learns the equi vatency of 1/10 centimeter to 1 mllUneter. 
The next three sections; teach the s^tudent to rule vertical and horizontal 
llnes^ on a blank sheet of paper In' the same place as the lines already 
drawn on a«permanent model. The final ^wo sections; teach the studeijt to 7 
divide line segments Into halves and tenths. The student may rot enter apy 
of these sections until he masters the skills taught In the preceed-lrig 
lessons. ' % ' " - 

Pretest Procedures , * * . ' 

The Information collected through the pretest for the' Metric fleasure-"^ 
ment Program answers the ^^^followlng^ quest tons: 

1) Does the student possess .the- fine motor control to grasp and. turn^ 

a ruler? v ' \ ^ 

*2) Is the student able to count fro(^ 1 to 100? 
3) Is the student' able, to Identify the numbers from 1 to 100 both 

sequentially and put of. order? , . , \ 

k) Does the student possess the fine motor control to manipulates^ pencil 

through precis loft tasks? ' , 

5) - Does the student understand the concept of top and bottort? 
.6) Does the student understand the concept of fractions? 
7) Can the student write fractions? ^ 
3) Does the student have .simple dlvfsopf'skl 1 Is? 

9) Does the student understand the concept of the starting and an . 

ending point of a line segment? 
10) Is the student ^ble to mark off 1 centimeter, 1/2 centimeter^ and 
, 1/10 centimeter Increments of'a line using a metric ruler? , " 

'^J1) Is the student able to measure line segments to the nearest 1 centi- 
meter, 1/2 centimeter, and 1/10 centimeter? • ^ 
12) Is tKe s.tudent able to rule paper? 
' 13)' js the student able to divide line slsgments? 

\An ^l^lrmiatlve response to each '^of the first seven questions' Is pre- 
requisitiPto th^student's entry Into the progr^im. Question 3 refers to 
the' additional entry behaviors needed for placement In the last two sec- ' 
tlons of this program. Finally,' the last five qCfestions correspond to, the ^ 
major skflls taught Vn this proyram/ ^ ' • 

Lesson Procedures and Materials • ' 

The Metric Measurement Program was concepti^aW2;ed, latticed and written 
this year In response to a growltig need for this type of program. Many , . 
educators, feeling the Impact of the Senate's fletric Conversion Act of 
1972, now recognize this as an important skill for today'^s students. Very 
few materials or programs ^re available for teaching this ski 11, especially 
tb students with learning hand};gaps. ' ' ''^ 
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^ . When work began <in the Metric Measurement Program last fall, Team 
l}l*s RuleV Measurement Program was already In the second phase of Initial .-^ 
f leldtestlqg. Since the jsklll sequence for these twp programs is very 
similar, the prografR wri ter was able to profit from the experience gained 
in the 'development of the lesson- sequence for. ruler measurement. The 
Metric tieasurement Program was developed through the, first phase 'of Inltl.al 
fieldtestlng In just three academic quarters. Additionally, a supplemental : 
lesson sequence, similar to that developed for the Ruler Measurement Program, 

was written to teach the prerequisite fraction skills for this program. 

* " - * . *^ . ■ * 

The Metric Measurement Program cpns.lsts of 32 lessons arid k criterion ' r 
tests. V, The criterion tests, occurring throughout the sequence, assess a 
studentJ.S'^nastery of the specif U ski 1 is taugt^t in preceding lessons. , 
Gutfcessful completion (at^least 90% correct) of each criterion test is 
required before a sti/dent may progress to succeeding lesson's. TH% lessons* 
are written Iri the three-column format and are Intended for one-to-one 
administration. The lessons In this seijuence call .for the use of many 
specially designed Instructional materials. These Include approximately 
115 consumable worksheets, 16 non-consumable measurement al!ds,*and a 
series of $ plastic metric .rulers which provide gradually reduced cues and 
increasing detail. * 

-# 

Only a. few minor revisions In this program we^'e required ,ipn the basis 
of Initial fleldtest data collected t^ls year. Some sections of the teacher 
directions were condensed or Ve-wo'rded to Increase clarity. Originally, 
several lessons called for multiple student responses; these were broken 
down Into component parts to facilitate administration. Finally, suggested 
remedlatlons were added to a few lessons In which elrrors occurr'fe^ frequently. 

Initial Fleldtjsst Results / ' <^ 

- Subjects . Five, boys, all students at the EEU, served as. subjects^ for 
the Initial fieldtestlng of the Metric Measurement Program/ Threirof these 
students were eleven^ years old and one was ten yeafs old. These fpur boys 
were diagnosed as learnl^ng dlsable'ii'.and were enrolled, in an Intermediate 
class. The fifth subject, a thirteen year old hoy with learning and language 
disabilities, was enrolled In the EEU*s demonstration classroom. 

*• »' 

Procedures ♦ {The Metric Measurement Program was under the Immediate 
supervision of Mjke Roe^'one of the team ill Interns. Mike Wi^s the program, 
writer and he administered the sequence to th^ first ^three students. ^' * 
Ualt?er Berlin, the other Team HI intern, served as tnstruct^^r 'for the last 
two students. * * / ^ 

The lessons p.ratvided the Instructions used (Jurlng tftj/S phase of Initial 
fieldtestlng and were continual ly revised to reflect data/ Itiput*. Thus all 
instructions, clarifications and materials used in this fieldtestlng a^'e 
Included in the revised version of the Metric fteasuremertt Program. 

Results . The student response data for this program Vema I ned consls- * 
t,eritly ^bove the criterion level. ^There was no less^on on which more than 
one student performed below 30% correct on the f trs^t administration. ' * 
Because of the very* 1 iml ted'varlabi 1 1 ty In the data for the initial* field- 
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test subj^ts, thelr'mean scores, expressed in terms of percent correct, 
are presented ,In -Figure 35* Th^e means werfe computed, as the percent correct* 
divided by the rfumber\of admlnlstr;atlons pf _ that' lesson. Thus, If a_$j:uden.t_ 
scored, Below 90^. on- a particular lesson, that iesson*vyould be readmlnlstered 
and both scores would be figured In computing the group mean for that 
lesson. . ^ ' ' ^ ' . 



Dlsrcus'slon . The dat^? Indjcate that this Instructional program Is : 
effectlvejn teaching metric ruler meas^Jrement skills'* Because of the'JiIgh 
l^evel entry behaviors required by thl|5> program, and the limited population 
available ^t the £EU,Jt may not be possible to Includeas large and varied 
a sample ^Iti ^t he second pAase of In'ltlaJ fleldtestlng as would be"* desirable. 
However; *lf feedback from.one or two more adml nfstrators ^^t the EEU supports 
the data gathered In the first phase of Initial fleldtestlng, this program 
will be prepared for secondary fleldtestlng. *^ • ' x 

Current S tatus 

The^^fetrlc flea^u/^ement Program was latticed and written during the 
past year. A supplemental lesson sequence to teach prerequisite fraction 
skJlJs was also written. The first phase of Initial, fleldtestlng^ Involving 
five subjects, demonstrated the efficacy of this program. Thus It Is now 
ready for the second phase of Initial f leldtest Ing—admlnl stratlon at the 
EEU by one or two additional administrators.- , This phase should be completed 
In the 197^ Fall Quarter.' . The program wlir then* be ^ted and material? ' 
prepared for secondary fleldtestlng next winter. 



Summary 



During .the past ; two years. Team 1 1 1 conducted research on a prototyplc 
model for the development of efficient and effective Instructional programs. 
The model stipulates many steps In this developmental process. ^ Accordl ng 
to this model, there are ten sts^ges through which the programmer should 
progress the creation^ refinement, an^jd validation of an Instructional v 
sequence. These stages are: 



1) 

2) ' 

3) ' 

5) 
6) 
7) 

0). 

9) 
10) 



Ppssessi)kereq6lslte knowledge about* basic learning principles 
and the particular- subject area»to be programmed. ' 
Make primary decisions regarding spec^f Ic program g9alS and 
target population. 

Develop lattice for program to display tarsk analysis 6f the 
ski 1 1 sequence. v 

Develop pretest package to assess entry befhavlors and target 
sklll'sT . ^ ' , 

Decide on prog ram's, format. 

determine Initial fleldtest population. , ^ ^ i 

Initial fleldtest (concurrent wl th lesson v^J ting) . -"t 

Sepondaj^y fleldtest. 

Final f leldtest«df 'pntlre program. • , 

Produce and disseminate InstryctlonaJ program. 
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• ^ During the* ^ 373-^^37^^ adS?f^}|f year, the efficacy of "his model,\/as^ 
Evaluated t'hrough the^ development of several Instructional programs.^ 
) - F^eldte'st data gathered In this re^search gefterally validated, the major 
components of * the prototyplc modeh *SeveraVpr6cedura^ w^djf Icatlons were 
.tn^de as student *d^ta and administrator -fee'dback .Indicated the need for such 
slons; • A ' 

"^he Impprtartc^ofiR^revft^ and clarity In teacher directions' becarrw, 
evident wh^n* several program pretests and lessons required r^rl tlng^ thJs 

♦^^ar^t. Sr^fnllarly\ conyfenlent prdcv -.res ^n^eded ,to'be develijped |for r^ecordlng 
rdw dat? Q^-^-^ speciiFIc student responses) as;lessons were administered • 

^ It v?as*^lso oecessary to design ij^jjjropriate charts ;to display cumulative 
data' for each." program. Data pVesented v^n these forms pfovlde an^overvlew , 

' of a student's progress through a partl-cular Instructional s.equence. . y{ 




The modified 1 art fee system for tctsk 'analysis proved -ib be especially 
applicable t<r the nee/Ts/of .^lassroom^teachers at the E^U. Many of the^el 
.-^ teacher's^ mastered the latticing tichnltjue through Independent reading of a 
^working paper written by Drt., Deborah Smitif which describes the procedures 
involved Tn lattice construction^ These teachers reported that lattices . 
^- ,served useful guides for dally Iqssoo jIHannlng.- 

ThiErmost significant^ refinement olr the* ^ototypfc model made this year 
was the^xpanslort of the Injtlal f l*eldtest^stage to Include twcMlslflnct . 
phase!..* Thl-s Tnodlflcatlpn was made^for two reasdns: )f to airo»:v.for essential 
^ ' feettback from onefv^br two administrators In addition to the program'V/rlter;; 
and 2}, to p^rbvtde Wesson data from students of/ varylng ages arid diagnostic^ 
categories.. This sec'onc} phase enables- the programmer to evaluate both the 
accuracy of the 6ntry behaviors crlterl,^. and the efficacy of the developed 
lessoii sequence. . * * . *• i 

During the -past y^ar, Team 'Ill's research ;l nvolved ithe continued ' .^^ 
•development of , five Mnstrucrtl9nal progrartis % .dccordanc^ with the^ pro- 
ce4ures specif led;^ In^ the prototypal c model. • A ^Ixth program (metrfc ruler v 
1 " measurement) was conceptualised, latticed and. written. Additionally, four • 
auxiliary programs we^e. Initiated during the. past year. ' 
' ' * / * ^ ^" ^ ^ '* > , ^ * . *C 

I TJie. Shoe TTfit Pcggram was adminl stered the EEU tti^ls year to ^f^'- 
studeryts ranging InXage froin 5 Jto 18 year^^s^old. On the. basis of data - 
^ collected In t HI s* second* phase of Injtlal ^l^ldtestlng, sev^rpl f^vl'stons 
^v/erq^made ln\the les^bn sequence, ah'd new remedr.aflon sections were'added. 
Af^eK final ^edlllng, the tfegrctl^n's manuals for tl\ls program were p'-oduce^ 
and d|s!)trlbut3d to puWlc school^speclal educahon tisachers^or secondary 
f leldtestlng. Thi-s secondary fl'eld|€St population Incliides approximately' 
5P students, .ranging:'^] n, age from 3 to'13 years. ^ Student performance data ^ 
and teactier feedback fnom t^is flVldtestlng wllV^e collected In the 137^ 
I Qu/rtV. / V. ' 

The Make Ctrang^ '^'/ogram Ohddrwjuv 3ub;.t^..i-T *i .f. 4iut*< yoa*-. 
^ Three mlnl-progf>ifi iayel'ope^ during the t972-l573 .academic year — Col?t 
Dlscrlnrfnatlon/BlO D Ucrlmlfjot I on^, and rtoneyS/alues — required rewriting. 
: i\ fourth mlnl-brpgram — Coin Combrnq^trons was^wrltten to teach the 
skKIV of counting up 5ums of money through '25 ce^nts. The entire revised 



\sequence was admrni stered to several students at the EEU. The subjects for 
ahls first phase, of fnitlal fjeldtesti ng ranged in age from 10 to 13 y^ars. 
The second phgse of Inttlal fleldtisting will be conducted fgr the Make 
Xhange Program In thfe ISl^^P^M Oiarter.^ / ' . ^ * 

Initial f ieldtesting of the; Time Telling Promram was completed during 
the 1972-1973 ^year. However, two additional in-h^se administrations were 
conducted by the program writer this fall to ass^s thfe efficacy of 'the 
mass produced Instructional aids. As this data Indicated ^t the new aids , 
did not reduce the program's effectiveness,; the teacher' s manual was prepared 
for multiple production^ Because-of delays* in the printlr.j of data sheets ^ 
and teacher's moRuals, it was/not possible, to distribute thts program to 
secondary fleldtest sites this year,' Therefore, the Time Telling Progr^rrj.* 
will be submitted to secondary fieldtesting when the public schools open In 
September. - * ' / 

The1;iothes Fastening Progr3m> al though^prevhously latticed, was ^ . 
vVrltten during the past year. The three mini-programs comprising thlfe 
isequence zipping. Snapping and buttoning are presently undergoing the . 
first phase -of Irtltlal f Jeldtesting. l-t Is^antlclpatejcl that all Initial - 
fieldtesting for this program wlfl be completed by the' end of the, 197^* Fal 1 
Quarter. • ' 1 . ^ * 



Team Ill's Ruler Measurement Prdgcam underwent th^ second phase of 
Initial fieldtesting ^t the EEU' thl^ year with a sample af students ranging . 
In age from 11 to 13 years. This data supported the efficacy of the program 
and materials. Therefore, multiple program^ packages are now being prepared 
for secoridaryfLe Id testing in the publjc schools this fall. 

One new pTogfam^ designed to teach the skill of using a metric rgler.V' 
*was conceptualized, lattlc'ed .and written through the first phase of'l/ittl,?l 
fieldtesting, this year; ^The./letrlc Ruler Measurement. Program i^as administered 
to four students, 10 and* 11 years old, at, the EEU. This student data • . 
demonstrated the efficacy of the program In teaching metric measurement * 
skills. Therefoi^e, 'the secon^ phase of. Initial fieldtesting will be con- 
ducted for the Metric Ruler Measurement Program during the 197^ Fall* Quorter^ 

»' • ' ' * 

Four short programs were written this year as auxiliaries to existing 
programs. -The^ anft: Shcfe Lacing; Shoe Lace Tightening; Simple Fractions 
i1/8, lA,''and 1/?; and Simple Fractions 1/10 and Ml, 'When tnltljl field- 
testing is completed on these programs, they will be secondarily field tested, 
In the public ^6hools .as suppleme'n,ts. to the Shoe Tje Program, the Ruler 
Measurement Program, and the Metric Ruler Measuremtent Program. 

Durln'g the corning year. Team IN will complete Its research on the 
prototypif model forVreatlon of Instructional progrimsj^ This model Kas* 
been refined. Ip the past two years In order to make lt more' efficient and 
broadly applicable. It Is hoped that this prototypic model, as weU as/the 
Instructi^onal programs developed by Team III', wlll.be disseminated to.a 
large number of spe« la 1 educators when tT>ls project is concluded' next -year^ 
Through this dissemination should ^ome Improved educational pro^rammlrig'^for - 
^.anrflcappbd students of all ages arid levels of ablllty^^ 



/ : 
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Apoendix 



The Shoe Tie. Program 

Teacher's General Directions for Shoe Tying Program 
Essential Terms' (1 1 lustrated glossary) ^ 
Pretest , 
Lattice 

Data Col lection 

« 

Lessons: 

Lesson 1 
Lesson A. 

Lesson 1 i "T^Tas^lesson in this program) 
Remediation Lesson 



Teacher 's 'General Directions for Shoe Tylytg'^ Program 



• This instructional program was designed for individtJalilJed- admin- 
istra^tlon. ^ -Do not use the program with groups , 

E^ch lesson was designed to be given on a ^separate day.. Sinc« the . 
{JVogi^f^m is relatively ^ort and tfhe ^^.tudent needs to absorb each section 
^e*|ore mov^g on\ it Is not recoTnmen4^d that more than one lesson be , 
taught each day. Should it be needed','^ the Remediation Lesson may b^ 
used at any time during the sequence of the lessons., 

Pr e-reading the lessons - ^ ' . . • • • - ^ 

c ' Before tpacl^ing a les^soa, b,e certain to pte-read the ifistriictlons 
carefully. fsPractice each of the steps^llntit they seem- natural to you^ 
Be familiar with ail of tfie" steps and demonstrations^ required, and with' 
the instructions^ yoy say the, student. All directions sftould be 
followed exactly; all instructions^ should be stated;Kord tor word. , <^ 

Materials " • - ^ : ' • ^ " , 


Be^sure to have the necessary materials readily available, for ^the 
administration of this program. Jhese materials are' listed" at« the^top- ^ 
ot the pretest, and each' lesson.'? The .demonstration shoe may be^alnyshoe 
with tieClaces (t^'.-an adult's tennis aho0.or a hikihg boo-t)- which is 
la'rg^. enough' to. be^ easily tied. ^ ' . • / 

Criteria. ' ^ * S'' \a.\<^'*< \ ' 

L' The criteria or goals for. each lesson --tl\je sfcills..the st,0,<3ept is 
expected to possess before movtiigi dn to the next lesson —are 'descaribed 
at the top of eacK lesspn. ' Typically, in this program the student must 
perform the step or sequence correctly three consecutive *times, *; This 
^mean^ that the student inust perform the lesson's goals which are li^sted 
'.as th^e. criteria, three^times correctly without errors in between. If 
the student fir$t performs the- task correctly but* misses on the second 
trial, the count of correct trials starts over again. 

. ^ . ) 

A precise verbal response should not be (Jemanded'of students with 
limited verbal ability. Accept any approximation of the requested word 
or phrase, or if the student htis no speech allow him to indicate man- 
ually> (i.e. point, gesture, imitate) the correct, respoifse. 

' If the >student meets the criterion for a lesson, but you do not 
feel that tfie learner is truly proficient at the task, it* is left to 
,your discretion whether or not to proceed with the next lesson. 



Lesson fonhat • - 

The knowing format was developed for ease in administering? the 
lessona'. pn edch page, the iecotiS^column to the right contains your 
instructions. The directions are written in small letters. Phrases you 
•ay to th^ student ar^ written in capital letter?. ^ " 

i^irhe third column specif ies , the correct student jesponse.^ The final 
column, labeled "Remediation^' dndicates what ragocedures to implement if 
the student is unable to correctly execiite the response. 

Illustrations have^been provided for your convenience. Please 
refer to the drawings anytime you are directed to do/feo. If directions 
•e^ unclear, the illustrations may help, clarify "correct procedures* 
The' drawings are for your use only. \ ' 

Rata aheetb • ^ \ 

Each student response is coded on aji individtial data sheet. Please 
refer to* the- instructions and example on pages 15-16 for diVeptions. 

Reinforcement w ' ^ 

'HEVER fell the student that tying his shoes £s easy. It isn^t.. If 
it were, the student wouli^ be doing it. ^ \ 

Always praise tt^ student if ^e correctly performs i step required 
^ in the program. To reinforce correct, performance of any one step in the 
^rogffam, tell the student the specifll^sten he did appropriately. For 
example, if the ^sttiitet(t pulled the lace^ tight in the. proper manner, 
say: "Good, .you have just pulUd both laces tight. 'S. In this way, you 
establish completion *of a task and also indicate approval for good 
performance'! - » 

Constantly , check during the instruction period to We certain that 
the student is paying attention to your instructions and demonstrations. 
Should the student not focus on the task, give the student a prompt or 
cue to redirect his attention. Directions such as, " (student ^s name), 
look down here," or "(name), payattention to this," usually bring the 
student's attention towards the instructions* 

"Strong" vs. *^Weak" Hand 

In this program,, the "strong" hand refers to the student*s dominant 
hand - the" hand that the child naturally uses for most other tasks and 
skills (such as eating, drawing or writing, etc.'). If you are ♦lot 
certain which is the student.* s 4prainant or strong hand, either hand may 
be used, since the program teaches skills for both the dominant and tion- 
* doMnant hand. 



Laces / s 

— " ^ ■ . 

It is recommended that the teacher use long (extending at JLeast 12 
Inches from top hole), stiff laces for the majority of the pro^ram^ 
Laces commonly used .on skates or hiking boots work very veil £pr this 
purpose; however before; the student begins to tie his own shoes he 
should have the opportunity to work with soft laces on the' shoe. There- 
fore, around Lesson 8 or 9, replace tha 'stiff lace with a sq^ft shoelace 
similar to the laces found on the studunt^s own shoes* Thes^ laces 
43hould have reinforced . tips and should be firm^enoygh to maintain a 
distinct bow. When the shoe is laced, each of /the two^fvee ends- should 
extend hot less than nine inches, and not morfe than thlrtjeen Inches, 
beyond the "top' lacing ejrelets. 

Lattice ' ' / . 

The Lattice for S^ioes Tied is Included for' the^ teacher's Interest 
only*. It provides an ani^lysis of the components of the .task - shoe 
tying. Please refer to page 13 for"^ further explanation. ^ 

Let te r to t he parents 

r ■ -r f j(i M . . . , ^ 

t • 1 

...^ A letter should be' sent home to the parents the day the student 
enters the , program. The pux:pdse of this letter is to see that the 
student has tie shoes and good laces with whi^h to work. It is advlBable 
for you to have extra laces on hand in case the parents send the student 
to school with laces that are too short. , 

' , ' 

The letter^ below is provided for your convenience* If you choose 
to write your owp letter, please stress the step-by-step nature of the 
Instructional program. Ask the parents not to attempt to teach their 
ehlld to tie his shoes at hojne, wh^le you are teaching him at school. 
This request is made because of the number of variations available to 
tie shoes, pot because parents cannot instruct their children. 

DearLMr. and Mrs* (parent's name) ' 

(student's name) will be starting a shoe tying program at scfhool and 
will need to wear laced shoes daily. Please be sure he comes to ^school 
with laces which are in good condition, and are long enough to be easily 
tied. The Instructional program is sequenced.. Please do not Attempt to 
teach your child to tie his (or her) shoes at home. Everyone ha§ his 
own way of tying shoes » The program used at school follows a step-i)y-^ 
step procedure which might be different from your own. 

Thank you for your cooperation* " 

Sincerely yours, ^ ' - ' 



ESSENTIAL TERMS 



..X 



is 



The 'following ' terms must be understood by yoii before the pretest or 
.leasojiiB are begun: ' 



BOW 

^> 



BOW-KNOT 





The "bow" is the f Inatl ' • ' 

product in shoertylpg. . t 
^I^t consists of twoloop^V' • 
tied together wlth an'^ ^ - 
overhand knot. , >^ ^ , 

■ = ' -^ \y "■ - • 

• ; f- ■ ' ' . y- »• . 
4'.. ■ : "'^ 

The "bow-knot" Is the- 
overhand knot that holds 
the two loops together _ 
' to form^the bow. 



V 



HALF-KNOT 




The "half-knot" is the 
overbad knot which Is' 
normally made before the 
bow Is tied. ^ 




The fivj^ step (following 
the halt^knot) 1^ the 
"loop.'S The lace Is. 
bent anH pinched to form' 
the loop. 



' 4 

4^ 



The "Remedo-Board" is a slinple 
• device 4ised to faailiarize 
I student's with the pinching 

and\ pulling motions used' to tie 
' shoelaces* It consists of a 
^ piece of wood drilled with two 
holes in which knotted shoelaces 
.are secured for practicir^ the 
ijotions. ' 



\ ,Two portions of the shoe contain 
eyel^eCs (ho].es on the shoe that 
the- lace gbes through) . These 
portion^ o( the shoe are 
.referred to as the "shoe 
^ .flaps." 



\ / 



6 - 



TONGUE 




The "tongue" 'Is the central 
.pl«ce of material which lies 
under the shoe £lapi'. 
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V , General Pretest Directions ' . ^ 

9 « « m.^M m . ■ I . V ■ ■ ... ^ I ■ — ■■ .. t 

* * ^ . V 

The pretest is to be administered .with ^-ne child at a time * • ^ 

f * 

There are ten Sho-^ Tying^ Data Sheets for th'e pretest Included at 
the end of this booklet-; a sample sh^^et- follows the Pretest items, ^ One ^ 
Pretext , Data' Sheet should be used for eacH s^^^ If Alitor e are needed, 

>tKey>ai:eTeasily reproduced. % ^ ' > ' * ^ * 

T'^Place the dA^-a sheet in -a^onv^nienfe^ place for scoring, but be. 
certain ^to keep the sheet out of the view 'of The child. 



The materials needed for each section are listed directly under ' _ ^ 

each pretest title! ^Before you begin a pretest, be certain td have all ^ 

,^f the ^naterials apeded Yeadily available, Ch'feck ^the foilpiflnfe list for 

items yoif will need. - ' , - • 

/ • • . • 

- 1. Protest Sectlis^ns and Di rations 
• % Boot or shoe with tie lacjes 

4. Either a* stopwatch or wall clock with a-second hand 
6, • Three beads (These should be approxiniately one inch 
in diameter; The'hole^ln the center of the. bead 
/sKoul-a be just Jtarge enough for the shoe lace to pass 
' ' . ^ .'through freely. \ ^ ' * - ' 

6. Separate, shoelace . ' . * ^ . ^ 

\. 7. 'Pencil ^ ' v , 

The directions 4n each pretest section. tell the teacher exactly 
wl\at to do and say. The exact words the /te|fcher" should say to the child 
are in capital letters. • * ^ " 

Interpreting the Pret est : ^ ' < . t 

^ ' rP-.^ '■ \ ■ ' ' • 

In order •for a student tq^y^joTciilify for this program, he must score 
100% on Section? ll 4 Bt/d Nuipbec lb of ^Section 5. / ^ 

■ ' i .-^ r'.' ■ 

Section 1 ^ ^ , /^r ^ . 

\f the student dfee's not .score. 100% correct qn Nijraber^l, then continue 
the pretest. If the student sc*pi«fe^0O% ^cprredt on Nui^*fer 1, then con- 
tinue the prj^stest*, however, 'omit Sections 2, 3, and 4.^^ -"" 

, • . . . ; ^ 

If the" student ^scores 100% correct on Number 1, but^ doe^ not score 
100% on Number 2, then place him at 'lesson 11 in/the Shoe tie Program, 



\ . ■ ■ 

- 8 ^' 



Section '2 



Hi, irder for the student to score 100% correct, he must do the task 
within 30 seconds with. each hand. A score of 100% correct on this 
section is a grerequisite to entrance in the Shoe Tie Program. . 



Section 3 * * ^ 



. - vlf the studenx is unable to score 100% correct- on Number 1, then 
place hio at Lesson. 1 in the Shoe Ti'e Program. If the student scores 
100% cotrect on llumb*er 1, but- does not'scoi^ 100% correct on Number 2^ ^ 
then place hifa at LeSson Z in the Shoe tie ^rograSn If^ the student 
.scpres 100^ correct on both Number 1 and % then place him at. Lesson 3 
irf'the Shoe Tie Program.- ' ' . 

!gection 4 ^ ,. 

A score, of 100% correct on this section is a prerequisitie to entrance 
in the Shoe Tie Program,. , % . 

Sectlotl^- Auxiliary Skills 

A sdore of 100% correct on -lb is a prerequisite to ehtVance in the • , - 
Shoe Tie Program-.-. ^ ->^^ / ' yy-^ ' « . ■ '" r^ 'jc; • ^ 

. NOTEr Numbers l,r2 and '3 of Section 5 arejioclude^^^ in ^/^"^^^^^^^^^^^ \ 
provide the teacheV witfi an assessment of the Student's lacing, dressing, \ 
andjJLace tightening skills T 



\>' ^^^A^ .this tiife no program his been written to facilitate the teaching 
^ of these auxiliary skills. , 



4 

.1 



- / 



t 



\ 



I 



■ ' . ' . - 9 - 

Pretest Sections ^,nd Directlons j / 

If the ^tjixdeypt is "wearing a shoe which has laces, use the student s ^ 
shoe for those pretest sections which require the student to work with a 
shoe* If not, place the de^dtistration shoe directly in front of the . 
student on a* student-s'l^e desk with the heel facing the student*. Say^. J 
I TODAY WE ARE GOING ' TO SEE IF YOU ARE READY TO LEARN TO TIE YOUR SHOES. 
• IF YOU HAVE ANY PROBLEMS, DON'T WORRY.. I WILL HELP YOU WITH THE PARTS 
- TOU CAN'T "DO |LATER. ' *' • 

' WE ARE READY TO START. BE SURE TO-DO YOUR BEST. * . * 



Pretest - Section^; Ties and'Unties Shoe ' ^ , ' ^ \.^r^ 

-Materials: Shoe with tie' laces, data sheet , 
Place data sheet in front of you and out of. the' view of the student. . 

1. Untie the student's shoe and say: I WOULD LIKE TO SEE IF YOll CAN . 
TIE YOUR SHOE.' -TRY TO TIE YOUR SHOE FOR ME. 

2. If the stydentdid not tie his -shoe, retle it for him and say: I 
WANT TO SEE IF YOU (JAN- UNTIE YOUR SHOE. PLEASE UNTIE YOUR SHOE FOR M^. , 

V > ' ' • 

If 'the half-knot is tied and the bow-knot is untied, say: PLEASE 
UNTIE THE LAST KNOT. .'"'/•■,• 

Rerfove the shoe from the table- or plade the student's f oot^ on the floor. 
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Pretest - Section 2: Strings Beads with: Both' Hands , ^ ,P-2 

Materials: Threl^beads, lace, data sheet and stopwatch 

THI15'' SECTION IS TO BE TIMED . Place the beads and the-^lace In front of 
the child. ^ " ^ ' ^ 

I ^ ' ♦ 

1. Say: PLEASE P^LCK- UP THE SHOELACE* ' Note which hand the student 
used to pick up the la^ce. 

r ' ' * r - 

2. Have the student hold the shoelace in his right hand and says • 
PLEASE PUT THESE BEADS ON THE LACE. PLEASE WORK, AS QUICKLY AS YOU CAN. 

3. Remove the beads from the lace. Place the lace in the student's^ 
-left hand<tknd say: STRING THE BEADS WITH YOUR OTHER HAND. 



- 10 - 



Ptetest - Sectlog 3; .Pinches- Loop \?lth Both Hands and Pulls a Bow Tight .' P-3 
Materials: Shoe with tieaacefs, beadrlace, data sheet ' - • 

Remove bead^ ' . ' ' ^ / 

X. li6X& the lace in a loop which is about 3 inches long. Point to 'the ^ 
student's right hand and say: PLEASE PINCH 'THIS/ LOOP% , • 

If the student pinches the lace', " say: PLEASE LET GO. 7 Make another ,loop'. 
PINCH THE LOOP AGAIN, BUT THIS TIME WITH THE OTHER „HAND,, * • 

After the student pinches^ say? I.ET G0» . . . , 

2. The shoe should be untied. If it is not, please' untie itj'. Now - 
retie the shoe/'.but do, not complete the last step (do-inot pull the bow 
tight) . • ■ . I ^ ' '■ . , < ' 

.Point 'to the .student's right hand and to the right loop as you say: . 
NOW PINCH THIS LOOP WIT?- THIS HAND.,, 

O'ro • . '■' ' - \ ' ■ ' ~ 

Point to the student's left hand and to the left loop^as ^O" say: 
NOW Plto THIS LOOP WITH-^OUR OTHER HAND. MAKE SURE YOU i»INCH,*BOTH 
PART.S OF THE LOOP AT ONCE. \ . • ^ f 



Say: PULL THE LOOPS AWAY FROM EACH OTllER. 



\ 



X 



Pretest - Sectinn 4; Pulls Lace our of Eyelets with Both 'Tian'ds ' P-4 

y. 

. Material$: 'Ihoe with tie*'laces, a separate shoelace 
■ . • -, ■ . 

- Unlace-the shoe to the bottom two eyelets. These are the two eyelets 
/S^'cross from each other that the lace goes through first when lacing up 
the shoe.' Or unlace the top hole on each -side and strlfig a separate ■ 
shoelace through the two holes. - ^ 

1. > Point to the studen,t's right hand and say: PLEASE PULL THE LACE ©UT 
' OF TH^ HOLES WITH THIS HAND." ^ * ' ■• . 

1' 1. Restrlng the shoelace, '^o^t to the student's left hand aVCd .say:' 
' 'PLEASE PULL THE LACE, OUT- OF THE HOLES WITH THIS HAND. ' - " . 
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-^Pretest - Sectio n 5:' Laces a Shoe and Tightens th^ I^ces 
MaXiirlais,: • Shoe -with CieJ.aces 



1/ ReiDove the sho6 ^om'the student-'s foot. Place the shoe in front of' 
* tVie studefit pn a studeiit-size table. The heel should face tlie student* 
^ and the lace should be separate from the shoe. ^* 

Jland the lace to theVtudent arid say; IJi^CE .UP THE SHOE. BE CAREFUL, 
BUT "DO IT.' AS QUICKLY AS YOU CAN. • • ' '° , ' " ■ 

If the studen't did not lace up the shoe, t>o:lnt to uhe bottom eyelet and * 
POT THE LACE THROUGH THIS HQLE. 

lb. *?oint to. thp corresponding hole across from the holo which w^s jdst 
threaded and say: NOW PUT THE*LACE THROUGH THIS 'HOLE.. 

If the student is* unable- tp lace up the shoe, finish lacing the 
^' shoe ^Sut do not tighten the laces. 

"Say:.- TIGHTEN UP "THE LACES. 

3', Say.: PLMSE PUT YOUR^ SHOE BACK ON YOUR FOOT. (If the demonstration ^ 

^hoe was used for"^ha above sections," remove the ^tudent's shoe and use 
Che above direction) . n • ' 



\ 



\ 
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Ties Shoe 
Un.tie4 Shoe 



2- 



Picks up Lace 



Strings Beads 



• • 1 

Corrject , ^ 


Incorrect 


< 

Promo t 






^ '/i 








i — ^_ — ^ — ^ 




s 

A 


'(Y 


es of -No) 






• (Right or Left) 




Ripht Hdnd 


Left ,Hand- 


s' 

Time 


• 




I'. ■ 






.1 




•i * 



ift.Hand 



Pinches Bow 
Loop 

Right Hand 
Left Hand. 
Pul 1 s Bow 
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Yes ^ ' No - 

















p-A 

Pulls Laces out of eyeUts 



Right Hand 
^Left Hapd 



P-5 



K Laces Shoes 

K . 

iC^Puts Laces tn 
eyelets^ 

2, Tigljtens Laces 

3. Puts ohVShoe, 
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sh6e tying data for pretest 



Incorrect Prompt 



jYes or No) . 
jRight or Lefj:) 

i 

id Left Hand Time 





■ r 






y 





Left ^and 











1 No 
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p-4 



Pulls Laces out of eyelets 



Yes 



No 



Right Hand 
Left Hand 




J 


: ' ~ ^ 






: 1^ 

\ ^ ' ' 


P-5 


.. ' ...^ , 

Yes » ^0 , 


1, Laces Shoes 

la. Puts Laces !n 
eyelets 

2* Tightens Laces 
3. Puts on Shoe 




0 
















\ 



- 13 - 



J 

Interpreting the Lattice ^ 

Before the Shoe Tying Prograa %ias developed; the task ^- shoe ty^ng-^ 
, was subiitlied to an an^ytical procedure which was thc;^ display^ In a 
lattice Torsa^. A lattice is a graphic display of a single educational / 
skill idiich has been systematically analyzed. Its purpose is provide 
a pattern f^r a sequential list of the major parts of a specific skill/ . 
A lattice 14. a masterpian, not an' outline for teacUng} because it \does 
not include the exact steps or teaching strategies used in the educational 
sequences. ^ ' 

MiJ or elements of the task analysis process are as follows: (1) 
Identification of the skill —In this case, "Shoes, Tied" is *the final 
objective. A student stay be deficient in putting his shoes oh his feety ^ 
but that is a different task and thus^wotild not be included in the Sbbe 
Tying Program. ' (2) Determination of ''Entry Behaviors'* - The programer 
decides what skills will be required of students beginning a lesson 
sequence in order to Insure more efficient instruction. (3) Analysis of 
the skill - Each major step Involved in acqulrihg a skill is identified , 
and the sequence of the steps, is established. (A) Sequencing of the 
steps used I to complete the task « A hierarchy of skills is determined 
concurrently with sequencing the steps. ^^^^ 

In the Lattice for Shoes Tied, tjie "1/2 Knot, Tied" and "Bow Tied" 
are tyo Wjor coH^oneni: parts - subgoals of, the final gO£iI. Those 
behaviors whi^ch lead to the realization of subgoals are placed under the 
subgoals to represent the hierarchy of- steps used to complete the task. 
When reading the lattice, begin at the bottom left-hand colmpn and read 
tcr' the top of thai: colusm;- beginning at the bottom of the 2nd columa, 
continufi*^ in the same way until you reach the last box in the upper right 
hand comet - the terminal behavior. 



/ 
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Instructions for the Data Sheet 

The format of tKe Data Sheet is designed t<cr^ov±de an ovjerview of 
the student's progress throughout the program." There are ten Data 
Sheets included at the end of this booklet; one sheet, whiqh encompasses 
all the lessons, should be used for each student. If more are needed, 
they are easily reproduced. An Example Data She^t and a sample Data 
Sheet are provided for further e:q>lanation. • 

The data chart's vertical axis is labeled "Criteria Correctly 
Completed.". These criteria, on the left side of the chart, correspond 
to the major criteria of each lesson in which proficiency is required 
biff ore advancement. The horizontal axis labeled "Consecutive Scltool 
Days in Program," represents the days in sequence on which a lesson was 
administered to the student. ^ 

To properly use the data chart, ^locate. the lesson c?:iteria which 
correspond to the lesson just administered and the proper day in sequence 
Mark those criteria which the student correctly co^ppleted with an "Jc" at 
the position on the chart corresponding to the' proper- day* If the 
student did not meet specific criteria then those criteria should be 
marked with an "0" at the position on the chart correSpbnding to the 
proper day. 
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Example Datasheet 



U. Titlliis lit* 

r huu\ u\\ itiM tr ill 

T. U\h til tiiM titiitniiiit) lilk 
nrdsHt^iil Itilt , ' ' 

K^m tu| «it| "ml" Uii 
ilit Am "sttiH" i»l 
fiitin til (IMS siiiniiiiistf lill 
(itrityiiitit lull 
4. liitlif Ui| ttti "ml ' ^u^ ' ^ 

y fiitiit iHi iiti**sttiii*' uii 



7. fiicltt III HUisis till till 
K f lulls ul tiliitit II iirlil MiiiH 
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This sappic illustrates data charted for the first 
three lessons of the Shoe Tie Program. On the first day 
of instruction, the^ student mastered the two criteria of 
Lesson V/t. Lesson //2 was also successfully cCrthpleted in 
one day. The criteria of Lesson if3 required three days 
to master* 

A student never advances to the next lesson until, 
he has become proficient in each of the criteria listed 
for the lesson in progress. 
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SHOE TYING PRQGRAM - LESSON 1 



\ \ 



Materials: Shoelace- ,^ 

jCriteria: Student pinches and released a shoelace,, three consecutive times correctly, 

• ' ■> \ ' ' •. - . . 

' ' Instructor • ' Student 




Sit beside, student. 



Section 1: Pinch on Verbal Command 



Teacher Demonstration 

Demonstrate clearly and slowly the 
pinchixii movements with the tlmmb 
and first finger of the hand which 
corresponds to the "strong" |iand of • 
the student as" you say: NOW WE ARE 
GOING TO LEARN HOW TO PINCH MD PULL 
A SHOELACE. FIR^T. I WILL SHOW YOU 
HOW TO PINCH AND THEN YOU CAN DO IT. 

As you demonstrate the movement; 
say: PINCH. Demc^strate and give 
command three times. ^ 



Section 2: Student Response 



Demonstrate how to hold thumb and 
first finger in open position* 

Say: NOW WE WILL DO IT TOGETHER. 
PUT YOUR HAND LIKE THIS. 

As you demonstrate the movement, 
say: NOW PINCH. (R-1) 

Wait for response and prompt if nec- 
essary. 



R-1, 



Pinched thtmb and first 
finger together with teacher^. 



SON 1. , '-^ - 

1 « . . 

hes and releases a shofelace, three consecutive times correctly. 

Instructor - . Student 
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Sit beside student* 

Section 1: Pinch on Verbal Command 



Teacher Demonstration 
. ■ ' ■ - i"' ^' 

Demonstrate clearly and slowly the 
pinching, movements with the thumb - 
^nd first finger of the haiid which 
corresponds to the "stroitg^l hand of 
tTie stydent as you say: IJOW WE ARE 
GOING TO LEARN HOW TO PINCH /\ND PULL 
A SHOEUfCE. FIRST I WILL SHOW YOU ' 
HO^^ ^0 PINCH AND THEN YOU CA.N DO IT. 

As yoju demonstrate the movement, 
say: PI>l'CH. ' Dernonsprate an*d give 
command three times. 



Section 2: -Student Response 



Efemonstrate how to hold thumb and * 
first finger in open position. 

Say: NOW WE^WILL DO IT TOGETHER. 
PUT YOUR HAND L*lKE THIS. 

As you demonstrate the movement, 
say: NpW PINCH. (R-1) . 

Wait for response and prompt if nec- 
O y. 

ERIC 



R-l» P^f.nches thumb and .first ^ 

finger together with teacher 



^ 



J. 



Instructor - 



Student 



Say: NOW \^ WILL SAY PE^CH AS'.WE 
DO IT TOGETHER. ' ' \ ^ 

Model^'the pinching mo'^'eraents as yc 
say: PINCH. (R-2) ' ' 

Section 3: Release on Verbal Conmiand 



' Teacher Demonstration 

Say: NOW WE ARE GOING TO LET GO, 
FIRST I WiyL SHOW YOU HOW TO LET 
GO AND THEN ^ YOU CAN DO IT. 

Demonstrate clearly and slowly. the 
pinching* mpvements as you say: 
FIRST I FINCH. 

Demonstrate clearly afid slowly th^S 
releasing movement as you say^^ 
AND NOW I LET GO.s • ' 



\ 



K 



Secticfn 4; Suiaent Response ^ 

Dem^strate how to hc'^d^humb and 
first finger in open Dositlon. 

$ay; NOW WE WILL FIW:H AND LET C4 
TOGETHER. l^LD YOUR HAND riSCE THIS. 

Demonstrate and wait for student 
response* (Prompt student' if nec- 
essary.) ^ \ ^ , 

Say'T-i^dW^INCH. (R-3) 



R-2. "Pinch." Makes plnchlrtg 
, ' movements with teacher. 



•4 • 



V 



R-3. i 



»7 



■"4 



inches with teacher.' 



instructor 



Say: NoW WE WIliT^AY PINCH AS WE 
DO IT. TOGETHER. / . 

Model the pinching mo^^eiuehts as' you 
say: PINCH^ (^R--2) 

Section 3: Release on Venbai Coinmand 



Xeacher Demonatratlbu 

- y 

Say: ^NOW WE ARE GOIl^p TO LET 
FIRST I WILL SHOK-YOU HOW TO LET^' ! 
GO AND THEN YOU CAN^ DO IT. 

^ 

Demonstrate clearly and slowly the ^ 
pinching movements, as you say: 
FIRST' I PINCH.' ' 

Demonstrate cTearly and slowly ^the 
releasing movement as'-you say: 
i\ND NOW I LET GO. ' 



1 

Section 4; Student Response 



Demonstrate how to hc^d thumb and 
first finger in open position. 

Say: NOW WE WILL PINCH AND LET GO 
TOGETHER, HOLD YOUR HAND LIKE THIS, 

Demonstrate and wait for student 
response. (Prompt student if nec- 
essary.) 

-^Q NOW PINCH. . (R-3) 

ERIC 



■;!v 

Studefft: 



R-2..^^^n?Jlnch'." Makes pindiing' 
^ ^ atoverfeats with teacaer.^ 



R-3. Pinches with teacher • 
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r 



LESSON- 1 



'V. • • 



ERIC 



Instructor 



Stiident 



Demonstrate and wait for student 
response.. (Prot^pt* student if nec- 
essary.) 

Say: AND NOW LET GO. (R-4) 

>^ 

Repeat Section 4 until the studjent 
correctly completes 'the task three 
consecutive times i 



Section 5; Repeated Practi ce 



S^y: NOW JOV^yXVL PINCH AND LET GO 
YOURSELF. FIRST Pm;H. • (R-5) ' . 



Ri^4. Lejts go with'teacher. / 



Repeats Section 4 "three 
torrectly. 



Wait f6r student response.- (Prompt 
student if necessaryr) ^ 

Say: NOW LET ^GO.^V -<R-6) ' 

Wait for student response, (pi^t ^ 
4i necessary.) . ^ 

%r ' ' ' 

Sectioni 6: PinchiiBig Shoelace 



Teacher Demonstration 

Hold the iace in Wft;b,and by. one end 
of * the lace. » The lace ^^hduld be held 
at' sttident*s snbulder ^evel. 

S^y: WE ARE GOING 'TO LEARN TO 

PINCH A. SHOELACE. ' FIRST ,1 WILL. SHOW 
YOU AND^THEl^YOU CAS.DO IT. 

, ' - ^ . , • J, 



• . 1 

times 



R-5. Piftchfes. 



R-6.. jLets go; 



\ 



Ins true tor ^ 



Student 
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Demonstrate arid wait for student 
response. (Prompt student if nec- 
essary.) . ' ' 

Say:'' .AND. NOW. LET GO. - 

Repeat Sec'tion 4 untiij the student 
correctly completes the task three 
consecutivife times. 



Section' 5:- "Repeated Pract4ce -> 



Say: NOW^ YOU WILL PINCH AND LET pO. 
YOURSELF. FIRST PINCH. (R-5) 

V; / • ' 

Walt for student resp9nse. (Prompt' 
student if necessary.): 

Say: NOW LET GO.. (R-6) 

¥ait for student response. (Prompt 
if necessary.) 



Section 6: Pinchinp^ Shoelace 



/7 



R-4. Lets 'go with teacher. 



Repeats Section 4 three 
'correctly. 



R-5. Pinches. 



R-6. Lets go.' 



times 



Teacher Demonstration 

Hold the lace^n lef t hand b^one end 
of the lace. The lace should-^ held 
at student *s s.houlder level. \ 
*' * . * 

Say: NOW WE ARE GOING TO LEARN TO 
PINCH A SHOELACE. FIRST J WILL SHOW 
YOU AND THEN YOli CAN DO, IT. 



FRlC 



\ 



.LES-SON IV. \ 



Insttuctor 



Pinch lace Vith right hand as yoi^ 
say: . WATCIT CAREFULL^/ I PINCH THE 
LACE. . ' ' ' 

Let go 6i the lace with right Itand 
as vou say: NOW I tET GO OF THE 
L^CE. , " ' ' ' 



S ection' 7: Student Pinches Lace 

■"■^^"^"^ ' if"" ^ 



Still holding .the lace, extend it 
toward the child. Point .to "strong" 
hand of -the child as yoju say: ' 

YOU ■ FINCH. THE LACE' WITH THAT^ • 
Hand. ,(R-7.) . - T 

Say: AND NOW LET .GO OF THE- LACE, 
(R-3) . " \. 

Repeat Section ^7>intil the student 
Correctly comprises the task three 
consecutive 'times.. ' / t 



.'Stu dent 

-¥rrr^ 



0 



7 



K-'7. Pinches lace (^ith' "strong^* 
hand - 

R-8. Lets^ go of lace. 



/ 

Repeats Section 7 
times correctly. 



three 



Instructor 



Student 
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Pinch lace with rljht hand as you 
Isay: WATCH CAREFULLY " 
ILACE. 



1 PINCH THE^£ 



iLet go of the IS^e with right hand 
IS you say: NOW I LET GO OF THE 

Ilace. 



tse'Cjtioa 7: Student Pinches Lace ' 

IS till holding the lace, extend it 
j toward the "child/ Point to "strong*-* 
IhanQ of the child as you s^y: 

■YOU PINCH THE LACE WITH THAT ^ 
IHAND, (R-7) 

ISay:- AND NOW LET GO OF THE LACE. 
|(R-8) 

luepeat Section 7 until the student 
Icorrectly completes the task three 
(consecutive timers. 




Pinches lace with "strong" 
hand* V 



R-8. Lets go of lace- 



Repeats Section ^ fhree 
times correctly. 



SHOE . TYING PROGRAM - LESSON 4 * 



Materials: Shoe with tie laces 

Criteria:. Student pinche§ lace just as it comes through the hole, pulls loop through and tighte' 



three consecutive times correctly.x 

Instructor 




Student 



Place shoe in front^^f student, 
within his reach on a student- 
size table. The heel should face 
the student and the laces should 
be tied to the point of tighten- 
ing the loops. 

Sit beside student. 



Section 1; Review Lesson 3 Criteria 

Say: YOU PINCH IHE^ LOOPS AND PULL 
TOEM AWAY FROM EACH OTHEB^(R-l) 

Loosen the loops and repeat Sec- 
tion 1 until the student correctly 
completes the task three consecu- 
tive times. 



Section 2: Loop-Making 

Teaclier Demonstration 

Untie the bow-knot, but leave the 
half-knot tied. ^ 

Say: WATCH CAREFULLY, NOW I AM 
GOING TO SHOW YOU HOW TO MAKE ^ A LOOP. 

Pinch the lace with your left hand 
so it forms a loop and say; I PINCH 
IT LirK THIS <iHuc;fraMon . 



R-l. Pipches loops and pulls away 
from each other. 

Repeats Section 1 threj^ time 
correctly. 




/ 



t^e laces , c <^ 

inches iace-just as it comes through the hole, 'pulls loop through and tightens bow 
secutive times correctly. 
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Instructor 



siudent 



Place. shoe in frqnt of student, 
within his reach ofn a student- 
size table • The ^eel should face 
the student and the laces should 
be tied to the point of tighten- 
ing the loops. 

Sit beside student. 



Section 1m Review Leg ^ son 3 Criteria 

Say: YOU PJNCH THE LOOPS Alld PULL 
.THEM AWAY FR^M EACH OTHER. (R-1) 

/ 

Loosen the Idops and repeat Sec- 
tion 1 until the student correctly 
coinpletes the] task three consecu- 
tive times. 



Section ::2 ; Lo^p - Making 

Teac her Demonstration 

/ 

Untie the bow-knot, but leave the ^ 
half-knot tied. 

Say: WAT6H CAREFULLY. NOW I AM 
GOING TO SHOW YOU HOW TO MAKE A LOOP. 

Pinch the lace with your left hand 
so ic foi^^s a loop and say: I PINCH 



Remediation 




. f 

R-1. Pinches loops and pulls away 
from each other. 



Repeats Section 1 three times 
correctly, ' , 



Instructor 



Student 



Make certain you hold the lace loose- 
ly as you wrap it around the 
Ipop^n your left hand and say: NOW 
^BRING THE OTHER LACE OVER MY, 
FINQERS LIKE THIS (illustration b),. 



Push the lace through the hole so it 
extends through the hole by no inore 
than U'" as you .say: , NEXT *I PUT THE 
tACE THROUGH THE HOLE (illustration 
c). 



Drop the laces so the student can 
pull the bow tight and say: NOW YOU 
PULL THE LOOPS AWAY FROM EACH OTHER. 
(R-2) . 

Repeat Section 2 until the student 
correctly completes 'the task three 
consecutive . times 



\ 

R-2. Pulls loops away from eacn 
otJier, 

Repeat^ Section 2 three times 
correctly. 



Instructor 



Student 
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Make certain you hold the lace loose- 
ly as you wrap it around the 
loop in your left hand and say: NOW 
I BRING THE OTHER LACE OVER MY 
FINGERS LIKE^THIS (illustration b) • 



Push the lace through the hole so it 
extends through the hole by no more 
than li" as you say: NEXT I PUT THE 
LACE THROUGH THE HOLE (illustration 
c). 



Drop the laces so the student can 
pull the bow tight and say: NOW YOU 
PULL THE LOOPS AWAY FROM EACH OTHER. 
(R-2) 

Repeat Section 2 until the student 
correctly completes the task three 
consecutive time^. 



R-2, Pulls loops away from each - 
other. 

Repeats Section 2 three times 
correctly* 



LESSON 



Instructor 



S^tudent' 




ERIC 



Section 3; Repeated Demonstratfon ' 
and Practice 

Untie the bow-knot. Say: I WILL 
HELP YOU MAKE THE LOOP AND BOW. WE 
WILL DO IT TOGETHER. PLEASE GIVE ME 
YOUR HAND. 

Make tbe loop as you hold the stu- 
dent's left hand in position to 
pinch the loop (illustration d) . 

Say: PINCH THE LOOP. (R-3) 



^R--3. Pinches loop with teacher* 



Bring the other lace around your 
fingers as you say: NOW WATCH CARE- 
FULLY WHILE I MAKE THE OTiiER LACE 
GO OVER YOUR FINGERS. ^ 

Put the lace through the hole as you 
say: NEXT THE LACE GOES THROUGH 
THE HOLE LIKE THISr 

Release the student's left hand and 
say: NOW YOU PULL THE LOOPS AWAY 
FROM. EACH OTHER. (R-4) 

Repeat Section 3 once or until the 
student correctly completes the task 
two consecutive times. 



R-4. 



Pulls loops away from each 
other* 

Repeats Section 2 twice 

correctly. 



instructor ' 

Section 3; Repeated Demonstration 
and Practice 

Untie the bow-knot. Say: I ViLL 
KELP YOU MAKE THE LOOP AND m\ WE 
WILL DO IT TOGETHER 1 PLEASE GIVE ME 
YOUR HAND, ' 

Make the Ioqp as you hold the stu- 
dent's left|nand -in position to 
pinch the loop (illustration d) . 

Say: PINCH THE LOOP. (R-3) 



Student 
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R~3. Pinches loop with teacher. 



Bring the other lace around your 
fingers as you say: NOW WATCH CARE- 
FULLY WHILE I MAKE THE OTHER LACE 
GO OVER YOUR FINGERS. 

Put Che lace through the hole as you 
say: NEXT THE LACE GOES THROUGH 
THE HOLE LIKE THIS. 

Release the student's left hand and 
say: NOW YOU PULL THE LOOPS AWAY 
FROM EACH OTHER. (R--4) 

Repeat Section 3 once or until the 
student correctly completes the task 
two consecutive times , 



ERIC 



R-4. Pulls loops away from each 
other. 

Repeats Section 2 twice 
correctly. 





Instrxi(^- 



or 



Section 4: 



Gtudent Pinches Lace as 
It ComVs through tihe 
Hole, Pulls Loop through 
and. Tightens Bow 



Untie the bow-knot* ^^ay: I WILL 
HELP YOU MAKE THE LOOPED BOW AGAIN. 
WE WILL DO .IT TOGETHER. PLEASE GIVE 
ME i'OUR HAND. 

Make the loop as you hold the stu- 
dent's left hand in position to 
piuch the loop\ Say: PXNCK THE 
LOOP. XR~5) 

Continue tying the bow up to and 
including the point at which the 
loop protrudes appro? Imately 1/2" 
througl^tha hole,, (illustration e). 



Point to the student *s tight hand 
as\you say: PINCH raE'BIG LOOP WITH 
THAT HAND. (R-6) 




Poi^^to the stu-^'^intVs left hand as 
you say: NOW LET GO WITH THAT HAND. 
XR-7) 

Point to the student *s left hand 
again and say: NOW PINCH THE LITTLE 
LOOP COMI^fG>THROUGH THE HOLE V7ITH • 
THIS H^\Nd/ (R-S) 



Studeirt. 



R-5. Pitches loop with teacher. 



R-6. Pinches big loop with right 
hand. 



R-7. Lets go with left hand. 



R-8. Pinches little loop with 
left hand. 



If 
lo 
fa 
ar 
mo 
on 
In 
ha 
th 



Instructor 



Student 



' ^ page 36 \ 
Remediation 



e ction A; 'Student Pinches Lace as 
It Comes tHrough the 
Hole» Pulls Loop through 



apd Tightens Bow 



ntie the bow-knot, • "^ay: I WILL 
ELP YOU MAKE THE LpOP AND BOW AGAIN. 
WILL DO IT TOGETHER. . PLEASE GIVE 
YOUR fiAND. ' 

ake the loop as you hold the stu- 
ent's left hand in position to 
inch the loop. Say: PINCH THE 
OOP. (R--5) 

ontinue tying the bow up to and 
ncluding the point at which the 
cop protrudes appro '.inately 1/2" 
hrough the hole (illustration e). 



oint to the student's right hand 
s you say: PINCH THr^IG LOOP WITH 
THAND, (R-6) 

oint to the student's l^ft hand as 
ou say: NOW LET GO WITH THAT HAND. 
R-7) 

int to the student's left hand 
aln and say: NOW PINCH THE LITTLE 
.OP^^COMING TOROUGH THE HOLE WITH 
IS H/\ND. (R-8X 

er|c_ 



R-5. Pinches loop with teacher. 



R-6. Pinches big loop with right 
hand. 



R-7. Lets go with left hand. 



R-8. Pinches little^ loop with 
left hand. 



If student is not pulling 
Ipops so as to produce 
fairly even bows, reach 
around his shoulders and 
model the correct behavior 
once. Follow this model^ 
ing by taking the student' 
hands and assisting him 
through the movements. 



'• Iti^tructor > 

Say: ANk NOW ?ULl, THEy^OOPS AWAY 
FROM EACH OTHER. (KtW 

Repeat Section 4 until the student 
correctly completes the task three 
consecutive time&. 



c 



A 




Student 



Pulls loops av^ay from each 
other to tighten bow* 

Repeats Section 4 three times 
correctly. 



Instructor 



Student 



Say: AND NOW PULL THE LOOPS AWAY 
FROM EACH OTHER. (R--9) * 

Repeat Section 4 until the student 
correctly completes the task three 
consecuti e times. 



ERLC 



1 



R-9. Pulls looj^s away from each 
'other t\> tl^ten bow. 

Repeats Section 4 three times 
correctljr., 



SH OE TYING PROGRAM - LESSON^ 11 

^Materials: Student's la'ced shoes 
Criteria: Student ties and unties his shoes. 



Instructor 
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/ 



Place one foot on waich the shoe 'is 
tied on edge of. chair. Sit beside 
student. 



Section 1; * Untying tfie Bov-knot 
Teacher Demonstration 



Say: NOW YOU WILL LEAKN TO UNTfE 
YOUR 01^ SilOE. FIRST WATCH ME ^ 
CAREFULLY , 

Pinch the en^d .of, on^" lace in one ^ 
hand and the, end of the other lace 
in the oth^ hand* as you say: ^ 
I PINCH THE END OF ONE LACE 
TIGHTLY. DO NOT PINCH A LOOP. I 
PINCH THE END OF THE OTHER LACE IN 



MY OTHER HAND, Pull the laces and ^ 
untie the bow as you say: NOW I 
PULL THE LACES AWAY FROM EACH ' OTHER 
L^TIL THE LOOPS ARb GONE. 

Retie the student *s shoe atid repeat 
Section 1 once- 



Section 2:- Studen t Unties Bow 

and Reties his^ Shoe ^ 

Leave the student's laces untied - 
Have bin exchange feet on the chair, 



LESSON 11 • 
s laced shoes 

•ties and unties his shoes. 

Instructor 



Place one foot: on uaich the shoe Is 
tied on edge of chair. Sit beside 
student. 

♦ Section 1: Untying- the Bo.v-knot 

Teacher Demonstration 
p ■ '■ ■ ■ ■ — — — — . — 

Say: ' NOW YOU WILL LEARN TQ UNTIE ^ 
YOUR OWN^HOE% FIRST 'WATCH ME 
CAREFULLY^ ^ 

Pinch the end of one lace in one** 
* hand and the end &f the other lace 
in the other hand as *you say: 
I PINCH THE END OF ONE LACE 
TIGHILY* DO NOT PINCH A LOOP, • L 
, PINCH THE END OF THE OTHER LACE IN 
• m OTI^R\HAND. \Pull the laces and ^ 
unti&,.^e bow as" you say: ,NOW I 
•plTfL THE LACES AWAY FROM EACH OTHER 
UNTIL THE LOOPS ARL GONE. 

I * ^ 
Retie the student's shoe' and repeat 
Section 1 once. t . 

Secti on 2: Student Unties Bow , 
a nd Retie^ his Sh oe 

« 

Leave the student's la'ces untied, 
^ liavG bin exchange feet on the chair.* 

ERIC r / 
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Student 



2 



Remedlati'on 



UiSCN iL 



ERIC 



Instructor 



Say: NOW YOl/ WILL UNTIE THE BOW ON 
.YOUR OTriER SHOE. 

PINCH THE END OF A LACE IN 

YOUR HAND. BE CARE. JL NOT TO PINCH 

A LOOP. (R-1) 

NOW PINCH THE END OF THE OTHER 
LACE WITH YOUR OTHER HAN; (R--2) 

NOW PULL THE LACES AWAY FROM 

EACH OTHER UNTIL THE LOOPS ARE GONE, 

Untie the haj^-knot on the student^ s 

'shoe. 

Say:. TIE^YOTTR OE. (R^4) 

Repe.^t Section 2 until' the student 
performs all of the responses 
correctly. ^. ' ^ 

Sectj.on 3: Untying the Half -Knot 
Teacher Demonstration 

Say: PULL THE LACES AWAY FROM EACH 
OTHCR SO' THAT THR LOOPS ARE GONE. 
(R-5) 

Say: THE BOW IS UNTIED, BUT lllERE 
TS ' STILL MORE TO DO. 



Student 



R-1. Pinches one lace. 

R-2. Pinches other lace. 

R-3. Unties bow. 

R~4. Ties shoe. 



R-5. Unties bow. 



Instructor 



Say: -NOW YOU WILL UNTIE THE BOW ON 
YOUR OTHER SHOE. 

PINCH THE END OF A LACE IN 

YOUR HAND. BE CARE. UL NOT TO- PINCH 

A LOOP. (R-1) 

NOW PINCH THE END OF THE OTHER 
LACE WITH YOUR OTHER HAND. ' (R-2) 

NOW PULL THE LACES AWAY FROM 

EACH OTHER UNTIL THE LOOPS ARE GONE. 

(R-3) 

Untie the half --knot on the student's 
shoe. 

Say: TIE YOUR f-HOE. (R-4) 

Repeat Section 2 until the student 
performs all of the responses 
correctly. 



Se ction 3; Untying the Half -Kn ot 
Teacher D^onstra t i n 

Say: PULL TliE TACES AWAY FROM EACH 
OTHER SO MAT IHE LOOPS ARE GONE. 
(R-3) 

Say: THE BOW IS UNTIED, BUT IHERE 
IS STILL MORE TO DO. 



Student 



R-1. Pinches one lace. 



R-2. Pinches other lace, 



R-3. Unties bow. 



R-4. Ties shoe. 



R-5. Unties bow. 
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LESSON 11 



Instructor 



Student 





Display your index finger on the 
hand which corresponds to the "strong^ 
hand of the child. 



Say: THIS IS 19{ FIRST FINGER* 
IS THIS? (R-6) 



WHAT 



Curve your finger so it is in a 
*'hooking** 'positiK)n» Insert your 
curved index finger under knot- 
Always perform^the task with the 
palm ot your- hand facing down* 
(See illustration.) Demonstrate 
how to untie half -knot as you say: 
WATCH MY FINGER UNTIE THE HALF- 
KNOT.^ I PUT MY FIRST FINOER UNDER- 
NEATH THE HALF-KNOT LIKE THIS. 

iHEN I PULL MY HAND UP IN THE AIR 
LIKE THIS. 

Retie the half-knot and repeat the 
above step once. 



Section 4: Untying the Half-knot 
Guided Practice 



Retie the half-knot on the st^Hent's 
shoe. 

Demonstrate, how to curve index 
finger and say: HOLD YOUR FIRST 
FINGER LIKE MINE, (R-7) 



R-6.^"Your first finger." 



R-7. Curves finger. 



Instructor 



Student 



Display your index finger on the 
hand which corresponds to the "strong 
hand of the child- 



Say: *THIS IS MY FIRST FINGER, 
IS THIS? (R-6) 



WHAT 



R~6. "Your first finger/' 



Curve your finger so it is in a 
"hooking" position. Insert your 
curved index finger under knot. 
Always perform the .task with the 
palm of your hand mcing down. 
(See illustration. )A Demonstrate 
how to untie halt^kn^^^s you say: 
WATCH MY FINGER, IOTTeTHE HALF- 
KNOT. I PUT }?{ FIRST FINGER UNDER- 
NEATH THE HALF-KNOT LIKE THIS. 

• HEN ' I PULL VlY HAInD UP IN THE AIR 
LIKE THIS* 

Petie the half-knot and repeat the 
above step once* 
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Section 4: Untying the Half-knot 
Guided Practice 



Retie the half -knot on the student's 
shoe. 

Demonstrate how to curve index 
finger and say: HOLD YOUR FIRST 
FINGER LIKE MINE. (R-7) 



ERLC 



R-7. vlurves finger i 



Instructor 



Student 



V 



RIC 



Say: NOW YOU PUT YOUR FIRST 
FINGER ijfNDER THE LACE. (R-8) 

/ 

%1S^ NOW PULL YOUR HAND UP IN THE 
AIR. (R-9) 

Say: GOOD - YOU HAVE FINISHED UN- 
SG YOUR SHOE. 



S 4c t ion 5 : Student Tics and Unties 
His Sboe s 

Say;' NOW 'HE YOUR SHOE. (R-10) 

Say: UNTIE YOUR SHOE. (R-11) 

Rave student put- otL^r foot on chair 

Say: NOW TIE THIS SHOE. (R-12) 

Say: NOW .UNTIE TinS SHOE. (R-13) 



Say:- GOOD! NOW YOU KNOW HOW TO TIE 
/\ND UNTIE BOTH OF YOUR SHOES. 

Say: TIE BOTH YOUR SHOES AND WE ARE 
DONE FOR TODAY. 

Check on shoe tying skills one day 
after the completion of the last 
lesson. Again 3 days after the last 
lesson... one week.. -two weeks. 

Contact the student's parents and 
T:equost that the student'^be per- 
-ilrtoa ^0 con.-,isr^nti/ I'i^* ^^1? shoes 



R-8. Puts finger under, knot. 



R-9. UntdTes half- knot. 



/ 

R-IO; Ties shoe. 

R-11. Unties shoe completely. 
/ 

R-12. Ties shoe. 

R--13. l/nties other shoe com- 
pletely. 



Instructor 



Say: NOW YOU PUT YOUR FIRST 
FINGER UNDER THE UCE. (R-8) 

Say: NOW PULL YOUR HAND UP IN THE 
AIR. (R-9) 

Say: GOOD. - YOU HAVE FINISHED UN- 
TYING YOUR SHOE. 



Se ction 5: Student Ties and Unties 
- His Shoe s 

Say: NOW TIE YOUR SHOE. (R-10) 

Say: UNITE YOUR SHOE. (R-11) 

Have student put otl.^r foot on chair 

Say: NOW TIE THIS SHOE. (R-12) 

Say: NOW UNTIE Tl^LS SHOE. (R-13) 

Sav: G.OOD! NOW YOU KNOW HOW TO TIE 
AND UNTIE BOTH OF YOUR SHOES. 

Say: TIE BOTH YOUR SHOES AND WE ARE 
DONE FOR TODAY. 

Check on shoe tying skills one day 
after the completion of the last 
lesson. Again 3 days after the last 
lesson... one week... two weeks. 

Contact the student's parents and 
rcquosL that the student be per- 
nitix to ^.on.-i I'-p'-:..' 'i-. Hi? '^hocs! 



R-8. 



R-9. 



R-10. 
R-11. 

R-12. 
R-13. 
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Student Remediation 



Puts finger 'under knot* 






Unties' half- knot ♦ 


• 




Ties shoe. 




• 


Unties shoe completely* 


t 




Ties shoe. 






Unties other shoe com- 
pletely . 






» 







/ ■ ■ - 

SHOE TYING FROGRA.M - REMEDIATION LESSON 



Materials: Shoe vith Tie Laces 

Criteria: Remediating specific skills throughout the lesson sequence. 



This lesson should be used if during. the 
course of the lessons the student dev- . 
elops deficiencies in learning to tie 
his shoas. For example, a student may 
forget a specific skill due to a lay- 
off period between lessons. 



In this lesson, the number in paren- 
thesis preceding each section heading 
is the number of the original lesson 
to which that section corresponds* For 
example, (3) "Section means that 
Section 2 corresponds to Lesson 3*s^ 
criteria* 

If the student has lost a specific 
skill, locate the original lesson in 
which the skill was taught, find the 
corresponding section in this lesson, 
and teach that section. As in all 
cases, the student must perform the 
section criteria correctly three con- 
se cutive times before moving on. , 

Following the successful completion of 
the remediating section^ it is advised 
to continue through this lesson, section 
by section in ascending order, until 
the student has reached the section cor- 
responding to the lesson in which his 
deficit was discovered. Rather than 
working through this section, he 
s!ir'ild be returned ro the normal lesson 



Instructor 



Student's Response 






MEDIATION LESSON 



J 



Tie Laces ^ 

g specific skills throughout the lesson sequence. 



ctor 



used if during 'the 
the student dev- 
learning to tie 
e, a student may 
1 .due to a lay- 
sons. 

ber in paren- 
section heading 
riginal lesson 
corresponds. For 
n:eans that 
Lesson 3's 



t a speci|^c 
fnal lesson in 
ught, find the 
in this lesson. 

As in all 
t perform the 
ctly three con- 
moving on. 

ul completion of 
n, it is advised 
is lesson, section 
g order, nintil 
d the section cor- 
on in which his 

Rather than 
ection, he 
the nornin] lesson 
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Student^s Response 
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Remediation 



remediation' lesson - 

Instructor 



,2) Section 1: Pinching and Pulling 

If the student has difficulty pinching 
and/or pulling, model the movements 
in the air and have the student imi- 
tate « 

If the above method does not help, 
teach Lessons 1 and 2 in their 
entirety. 

) Section 2; Studen t Pu lls Bow Tight 

Tie the shoe, stopping at the step 
where one pulls the loops to finish * 
the bow. Say: ^YOU PINCH THE "^.OOPS 
AND PULL THE BOV/ TIGHT. MAKE SURE 
YOU PINCH BOTH PARTS AT ONXE. PULL 
THE LOOPS AWAY FROM EACH OTHER. "XR-D 

Section 3: Student Pinches Lace Just 
as it Comes through the Holes, Pulls 
Loop through ^and Tightens Bow 

Tie bow up^ to and including the point 
at which' the loop protrudes approxi- 
mately through the hole. 

As you^old the student's left hand In 
position to pinch the loop, say: I 
WANT YOU TO FINISH TYINQ THE SHOE. 

Point to Che student's right hand and 
say: PINCH THE BIG LOOP WITH THAT 
a\ND. (R-2) 



T 



Student ^s Response 



R-1, Pinches loops and pulls bow tight. 



R--2, Pinches big loop with right \ vd. 



tor 



nd Pulling 

iculty pinching 
he movements 
student irai- 



s not help, 
n their 



Is Bow Tight 

at. the step 
ps to finish 
CH THE LOOPS 
>L\KE SURE 
ONCE, i PULL 
H OTHERu (R--1) 

ches Lace Just 

Holes, Pulls 
ns Bow 



ding the point 
udes approxi- 
hole. 

left hand in 
oopt say: I 
"G THE SHOE. 

right hand and 
P WITH THAT 
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Student's Response 
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R-1. Pinches loops and pulls bow tight. 



R-'2^ Pinches big loop with right hand. 



REMEDIATION LESSON 

* ' lugtructor 



Student's Response 



Point to the student *s"^left hatnd and 
sayr NOW LET GO WITH THAT HAND AND 
PINCH THE LITTLE LOO? COMING ' THROUGH 
THE HOLE. (R-3) 

NOW PULL THE LOOPS AWAY FROM EACH 
OTHER. (R-4) 

(5) Section 4; Student Pushes Lace through 
Hole and Finishes Tyin?>'the Shoe 

Make the loop and hold the student's 
left hand in position to pinch it. 

Say: I BRING TliE UCE OVER YOUR 
FINGERS. , • 

Point to index finger of student's right 
hand. Say: NOW YOU PUSH THE- LOOP 
THROUGH THE HOLE WITH THAT FINGER/ 
(R-5) 

AND NOW FINISH TYING THE SHOE. 
(R-6j 

(6) Section 5: Student" Brings Lace over 
his Fingers and Finishes Tying the Shoe 



Say:* I WILL MAKE THfe LOOP. Point 

to student's left hand and say: 

NOW YOU PINCH IT^liJITH TILAT HAND/ (R-7) 

HOLD THE OTHER LACE IN YOUR OPHER 
HAND, AND BRING THE lACE OVER YOUR 
FINGERS. (R-8) 

NOW FINISH TYIN"*; THH SHOE. (R-9) 



R-3. Pinches little loop with left hand. 



R-4. Pulls loops away from each other. 



R-5. Pushes loop through the hole. 
R-6. Finishes tying shoe. 



R-7. Pinches loop with left hand. 

R-8. Brings lace over his fingers. 
R-9. Finishes tying shoe. 



true tor 



t*s left hand and 
H THAT HAND AND 
P COMING THROUGH 

WAY FROM, EACH 

Pushes Lace through 



ing the Shoe 

Id the student's 
n to pinch it. 

CE OVER YOUR 



r of student's right 
PUSH THE LOOP 
THffiC FINGER. 



THE SHOE- 



Brings Lace over 
shes Tying the Shoe 



E LOOP. Point 
nd and say: 

THAT HAND. (R-7)- 

IN YOUR OTHER 
LACE OVER yOUR 



SHOE, (R-^) 
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Student's Response 
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R-3. Pitches little loop with left hand. 



R-4. Pulls loops away from each other. 



\ ■ 

t 

R-5» Pushes loop through the hole. 
R-6. Finishes tying shoe. 



R-7. Pinches loop with left hand. 

R-8. Brings lace over his fingers. 
Finishes tying shoe. 



f 5 



3t 



REMEDIATION LESSON 

i 

Instructor 



Section 6': Student Makes Loop and 
Finishes Tyin g the Shoe ' 

Say: • YOU WILL NOV; MAKE THE LOOP. Point 
to the student's right hand and say: 
BEND THE LACiE WITH THAT HAND . (R--10) 

NOW PINCH THE LACE TOGETHER TO 
FORM THE LOOP WITH YOUR OTHER HAND- 
(R-11) 

NOW FINISH TYING THE SHOE. (R-12) 

Section 7: Student Brings L ace throug h 
"Yep ee" and Fi>^i shes Tying ^he Shoe 

Say: I WILL >L^KE THE ^'lEPEE/' Bring 
the laces up into the '*tepee^* pos- 
ition - tight in front of left lace. 

Point at the left lace and say: NOW 
YOU BRING THIS LACE TOWARDS YOU AND 
THROUGH THE "TEPEE. (R-13) 

NOW PULL BOTH LACES AWAY FROM 
EACH OTHER. (R-IA) 

NOW FINISH TYING THE SHOE. 
(R-.15) 



\ 



V 



Student's Response 



R-io. Bends lace with right hand. 



R-31* Makes loop by pinching with 

left hand. 
R-12. Finishes tying shoe. 



R-13. Brings \eft lace throug*h "tepee." 



R-14. Pulls both laces away from each 
other. f 

R-15. -Finishes tying shoe. 



/ 



/ 



:ot 



THE. LOOP. Point 
^and and say: 
HAND. (R;-10) - 

rHER TO ^ - ' 
OTHER HAND. 



3E. (R-12) 

1^5^ Lace through 
ing the Shoe 



Stu(^ent^s Response- 



R-10- Bends lace^ with ri^ht hand. 



R-11. Makes loop by pinching with 

left hand, - 
R-12.. Finishes tying shoe. 
I 

\ ■ • ' 



:£PEE."^ Bring ^ 
epee" 'pos- 
ii left lace. ^ 

and say; NOW 
^DS YOU AND 
-13) 

from' 
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R-13. Brings left lace thtough '^tepee.^' 



R-l^. Pulls both laces away fr;om each 
other. • 



R-15. Finishes tying shoe. 
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Instrructcr 



-C^^ Sectio n- 8: Student Ties Half-Knot and 
Bow " 



-»<*y: VOU-^'ILL NOW -il?\KE-A -'TEPEE'. " ' HOLD 
A LACE i-N EACH H^LN'D. (R~i6) ' . 

Point to t;he student right hand and 
sav: THE urfe IN THAT HAND A'HWAYS 
GOHS^^N FRON'T Or TH^i: OTHLR Li ^E.\ ?UT 
ri!AT'T:ACE (right) .iN FRONT OF JWH OTHER. 

VOU H.\V£ NOW M/U)E THE ^'TF 
FINISH TYING THE SHOE. (R-idr 



Student Response 



R-16. Holds a lace in each hand. 



R-1?. Places fight lace in front of the 
left. 

R-18. Tier> shoe from *'tepee** step. 



r 
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Student *s Response 



ies Half -Knot and 



A ''TEPEE." HOLD 
(R-16) 

s righc hand and 
T.HAND ALWAYS 
'OTHLR' LACE, PUT 
FRONT OK THE OTHER. 



"TEPEE/' 
. (R-18) 



ERIC 



R-16. Holds a lace in each hand. 



R~17, Places right lace in front of the 
left. 

R-18. Ties shoe from "tepee" step. 



Retaediation 



TEA.". II: 
ASSESSHr.MT, I 'STRUCTIOi^" AMD 
hlTeGRATIO'! OF HAMDl'CAPPEO CHiLOREi 



Team Members * Coordinator: Or. Marie Eaton 

* Acting Principal: Mr. Dale Gentry 

Researcher: ' Ms. Kathleen Liberty (1/2 time) 
Researcher: Ms. Frances Anderson (1/2 tinie) 
•Researcher: Ms. Corrine McGuigan 
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